-- Logs begin at Fri 2022-08-05 18:47:39 UTC, end at Fri 2022-08-05 20:26:31 UTC. -- Aug 05 19:54:11.681835 dv-cinder-852210-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 05 19:54:11.689346 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 05 19:54:11.691319 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 5 19:54:11 2022] *** Aug 05 19:54:11.691319 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 05 19:54:11.691319 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 05 19:54:11.691319 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: nodename: dv-cinder-852210-2-iscsi Aug 05 19:54:11.691319 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: machine: x86_64 Aug 05 19:54:11.691319 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: clock source: unix Aug 05 19:54:11.691319 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: pcre jit disabled Aug 05 19:54:11.691828 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: detected number of CPU cores: 4 Aug 05 19:54:11.691828 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: current working directory: / Aug 05 19:54:11.691828 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: detected binary path: /usr/bin/uwsgi-core Aug 05 19:54:11.691828 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: your processes number limit is 47680 Aug 05 19:54:11.691828 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: your memory page size is 4096 bytes Aug 05 19:54:11.691828 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: detected max file descriptor number: 2048 Aug 05 19:54:11.691828 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: lock engine: pthread robust mutexes Aug 05 19:54:11.691828 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: thunder lock: enabled Aug 05 19:54:11.691828 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 05 19:54:11.691828 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 05 19:54:11.732544 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: Python main interpreter initialized at 0x55bd3186a9c0 Aug 05 19:54:11.732544 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: python threads support enabled Aug 05 19:54:11.732544 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: your server socket listen backlog is limited to 100 connections Aug 05 19:54:11.732544 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: your mercy for graceful operations on workers is 90 seconds Aug 05 19:54:11.732998 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: mapped 403077 bytes (393 KB) for 2 cores Aug 05 19:54:11.732998 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: *** Operational MODE: preforking *** Aug 05 19:54:11.733276 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: *** uWSGI is running in multiple interpreter mode *** Aug 05 19:54:11.733276 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: spawned uWSGI master process (pid: 103461) Aug 05 19:54:11.733485 dv-cinder-852210-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 05 19:54:11.737331 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: spawned uWSGI worker 1 (pid: 103462, cores: 1) Aug 05 19:54:11.737331 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: spawned uWSGI worker 2 (pid: 103463, cores: 1) Aug 05 19:54:11.737331 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 05 19:54:12.394558 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 19:54:12.403366 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 19:54:13.496280 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 19:54:13.496280 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: from cryptography.utils import int_from_bytes Aug 05 19:54:13.496929 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 19:54:13.496929 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: from cryptography.utils import int_from_bytes Aug 05 19:54:13.499973 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 19:54:13.499973 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: from cryptography.utils import int_from_bytes Aug 05 19:54:13.500396 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 19:54:13.500396 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: from cryptography.utils import int_from_bytes Aug 05 19:54:16.027266 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 19:54:16.027841 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 19:54:16.028033 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 19:54:16.028393 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 19:54:16.028671 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 19:54:16.029058 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.029381 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.029700 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.029961 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 19:54:16.030322 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.030411 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 19:54:16.030496 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.030623 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.030732 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 19:54:16.030941 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.031091 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 19:54:16.031260 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.031358 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 19:54:16.031593 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.031717 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.031852 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.032040 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.032165 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.032359 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.032488 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-2-iscsi {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.032702 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.032836 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.033033 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.033135 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.033342 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.033434 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.033658 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.033748 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.033977 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.034077 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.034303 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.034395 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.034561 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.034654 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.034873 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.035099 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.035211 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-2-iscsi {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.036252 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.036394 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.036510 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.036647 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.036739 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.036819 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.036896 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.036972 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.037098 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.037195 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.037281 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.037413 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.037502 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.037627 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.037728 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.037815 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.037974 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.038116 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.038282 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.038383 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.038677 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.038763 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-2-iscsi {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.038990 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.039081 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.039302 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.039389 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.039605 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.039705 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.039925 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.040036 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.040231 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.040321 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.040552 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.040712 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.040879 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.040976 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.041226 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.041328 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-2-iscsi {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.041538 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.041625 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.041862 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.041954 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.042692 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.042798 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.043016 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.043216 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.043441 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.043541 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.043748 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.043851 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.044057 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.044151 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.044366 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.044463 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.044712 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.044814 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.045018 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.045105 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.045322 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.045414 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.045573 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.045661 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.045879 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.045966 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.046201 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.046298 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.046522 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.046616 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.046836 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.046928 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.047085 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.047193 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.047334 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.047432 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.047651 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.047751 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.047958 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.048052 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.048261 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.048346 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.048566 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.048672 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.048892 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.048981 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.049199 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.049284 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.049445 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.049531 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.049694 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.049790 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.050009 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.050096 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.050325 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.050508 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.050628 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.050716 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.050930 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.051025 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.051231 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.051329 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.051533 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.051619 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.051834 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.051929 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.052135 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.052257 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.052437 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.052531 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.052762 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.052866 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.053076 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.053176 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.053387 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.053476 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.053708 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.053800 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.054014 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.054110 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.054333 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.054420 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.054642 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.054728 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.054947 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.055050 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.055249 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.055335 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.055561 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.055653 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.055887 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.055980 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.056185 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.056271 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.056436 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.056521 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.056761 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.056850 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.057068 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.057160 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.057388 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.057484 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.057753 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.058357 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.058639 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.058729 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.058953 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.059130 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.059255 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.059445 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.059563 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.059701 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.059869 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.060006 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.060174 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.060313 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.060480 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.060659 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.060811 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.060970 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.061115 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.061278 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.061427 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.061587 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.061730 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.061888 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.062034 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.062193 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.062350 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.062498 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.062669 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.062805 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.062972 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.063111 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.063276 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.063417 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.063580 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.063721 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.063884 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.064028 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.064202 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.064332 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.064505 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.064735 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.064825 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.065059 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.065146 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.065381 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.065480 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.065688 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.065775 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.065994 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.066087 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.066299 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.066394 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.066600 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.066708 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.066918 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.067028 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.067217 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.067340 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.067520 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.067645 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.067838 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.068042 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.068141 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.068359 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.068474 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.068682 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.068785 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.069001 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.069307 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.069612 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.069738 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.069929 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.070049 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.070228 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.070532 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.070914 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.071039 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.071222 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.071351 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.071584 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.071682 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.071890 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.071978 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.072193 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.072279 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.072496 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.072612 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.072825 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.072922 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.073129 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.073224 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.073477 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.073629 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.073817 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.074047 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.074139 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.074224 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.074447 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.074547 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.074755 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.074841 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.075060 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.075157 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.075363 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.075450 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.075681 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 19:54:16.075769 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.076015 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.076101 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.076338 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.076424 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.076675 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.076777 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.077005 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.077099 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.077315 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.077409 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.077625 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.077710 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.077937 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.078033 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.078253 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.078347 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.078563 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.078656 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.078885 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.079049 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.079197 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.079293 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.079504 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.079610 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.079816 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.079912 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.080123 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.080217 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.080434 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.080520 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.080835 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.081117 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.081208 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.081442 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.081528 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.081762 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.081854 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.082083 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.082170 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.082395 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.082481 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.082711 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.082803 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.083029 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.083116 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.083343 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.083440 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.083650 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.083746 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.083957 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.084042 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.084280 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.084370 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.084632 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.084740 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.084947 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.085038 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.085264 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.085359 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.085571 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.085668 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.085877 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.085963 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.086182 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.086275 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.086488 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.086590 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.086796 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.086890 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.087112 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.087197 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.087427 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.087512 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.087733 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.087818 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.088039 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.088124 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.088343 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.088430 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.088671 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.088775 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.089000 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.089516 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.089631 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.089945 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.090265 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.090523 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.090612 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.090847 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.090945 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.091165 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.091252 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.091471 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.091558 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.091783 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.091891 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.092091 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.092268 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.092415 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.092606 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.092773 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.092910 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.093085 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.093222 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.093427 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.093532 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.093736 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.093825 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.094052 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.094138 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.094365 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.094454 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.094677 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.094772 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.094984 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.095077 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.095297 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.095384 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.095610 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.095712 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.095915 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.096001 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.096220 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.096315 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.096530 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.096723 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.096858 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.096944 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.097158 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.097253 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.097473 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.097577 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.097778 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.097875 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.098076 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.098171 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.098392 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.098478 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.098692 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.098786 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.098995 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.099124 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.099306 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.099393 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.099611 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.099698 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.099919 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.100014 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.100224 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.100309 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.100530 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.100663 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.100900 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.100988 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.101205 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.101305 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.101511 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.101597 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.101837 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.101924 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.102150 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.102237 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.102450 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.102537 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.102756 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.102854 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.103062 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.103149 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.103372 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.103468 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.103670 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.103757 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.103974 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.104059 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.104273 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.104427 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.105104 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.105239 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.105414 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.105517 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.105724 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.105891 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.106025 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.106200 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.106329 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.106525 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.106632 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.106836 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.106923 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.107139 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.107233 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.107445 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.107542 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.107749 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.107902 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.108092 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.108215 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.108393 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.108537 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.108718 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.108807 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.109058 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.109144 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.109361 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.109457 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.109687 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.109784 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.109998 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.110085 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.110314 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.110413 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.110625 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.110712 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.110936 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.111023 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.111246 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.111391 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.111554 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.111677 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.111877 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.111992 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.112184 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.112298 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.112495 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.112642 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.112829 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.112953 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.113140 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.113261 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.113447 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.113559 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.113754 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.113866 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.114061 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.114174 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.114376 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.114488 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.114691 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.114867 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.115030 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.115151 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.115343 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.115463 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.115663 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.115785 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.115973 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.116088 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.116287 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.116400 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.116611 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.116746 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.116926 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.117017 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.117233 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.117327 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.117543 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.117637 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.117858 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.117946 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.118166 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.118252 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.118477 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.118575 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.118781 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.118866 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.119088 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.119173 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.119396 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.119491 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.119697 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.119782 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.119998 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.120085 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.121071 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.121206 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.121539 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.121627 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.121849 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.121936 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.122169 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.122258 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.122478 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.122566 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.122800 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.122894 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.123112 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.123202 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.123420 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.123506 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.123728 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.123827 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.124032 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.124127 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.124337 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.124423 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.124666 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.124771 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.124971 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.125057 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.125276 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.125391 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.125583 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.125679 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.125889 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.125976 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.126194 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.126288 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.126498 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.126592 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.126796 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.126884 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.127094 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.127180 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.127401 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.127488 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.127704 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.127790 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.128005 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.128110 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.128313 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.128404 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.128652 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.128743 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.128959 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.129045 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.129261 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.129394 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.129579 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.129673 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.129880 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.129967 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.130180 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.130266 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.130482 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.130568 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.130785 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.130871 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.131081 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.131342 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.131429 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.131672 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.131793 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.132172 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.132265 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.132481 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.132568 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.132808 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.132905 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.133125 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.133226 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.133444 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.133531 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.133750 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.133838 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.134063 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.134151 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.134426 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.134525 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.134748 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.134836 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.135058 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.135290 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.135432 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.135661 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.135751 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.136134 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.136415 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.136631 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.136907 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.137106 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.137272 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.137430 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.137562 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.137684 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.137813 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.137929 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.138107 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.138246 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.138415 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.138550 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.138768 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.138938 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.139117 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.139438 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.139674 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.139991 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.140358 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.140558 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.140712 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.140908 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.141297 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.141478 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.141627 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.141795 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.141954 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.142113 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.142279 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.142427 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.142614 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.142756 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.142944 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.143080 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.143288 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.143410 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.143728 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.143867 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.143961 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.144056 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.144193 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.144281 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.144499 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.144662 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.144836 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.144938 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.145145 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.145233 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.145454 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.145540 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.145752 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.145851 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.146058 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.146145 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.146358 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.146445 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.146659 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.146754 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.146956 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.147042 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.147256 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.147343 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.147566 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.147652 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.147865 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.147958 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.148168 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.148254 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.148467 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.148555 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.148808 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.148908 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.149113 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.149207 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.149408 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.149509 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.149710 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.149809 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.150006 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.150101 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.150343 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.150473 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.150644 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.150731 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.150976 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.151072 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.151297 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.151382 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.151677 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.151771 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.152276 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.152443 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.152558 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.152897 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.152992 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.153086 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.153177 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.153268 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.153350 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.153430 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.153510 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.153590 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.153774 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.153872 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.154079 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.154169 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.154380 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.154467 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.154688 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.154777 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.154994 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.155082 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.155297 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.155383 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.155598 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.155737 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.155891 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.155977 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.156194 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.156282 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.156490 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.156628 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.156819 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.156905 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.157122 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.157207 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.157417 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.157515 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.157715 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.157813 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.158016 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.158184 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.158318 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.158404 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.158611 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.158696 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.158914 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.159009 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.159214 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.159300 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.159524 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.159609 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.159820 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.159920 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.160118 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.160204 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.160412 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.160498 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.160739 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.160845 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.161047 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.161133 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.161342 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.161427 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.161661 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.161748 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.162035 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.162129 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.162338 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.162449 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.162703 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.162906 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.163036 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.163220 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.163337 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.163526 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.163824 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.164042 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.164115 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.164180 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.164245 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.164436 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.164525 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.164774 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.164875 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.165079 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.165168 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.165388 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.165483 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.165694 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.165782 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.165989 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.166089 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.166288 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.166378 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.166582 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.166669 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.166879 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.166964 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.167686 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.167777 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.167987 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.168081 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.168286 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.168374 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.168691 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.168795 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.169015 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.169102 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.169323 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.169418 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.169624 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.169710 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.169928 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.170053 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.170272 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.170445 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.170574 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.170792 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.170932 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.171097 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.171233 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.171453 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.171549 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.171757 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.171844 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.172072 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.172209 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.172391 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.172511 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.172755 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.172845 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.173059 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.173375 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.173680 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.173993 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.174296 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.174476 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.174596 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.174694 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.174915 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.175002 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.175223 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.175318 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.175530 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.175637 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.175849 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.175936 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.176170 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.176257 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.176485 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.176599 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.176808 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.176894 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.177114 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.177201 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.177482 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.177849 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.178167 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.178273 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.178356 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.178435 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.178435 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.178592 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.178671 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.178751 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.178976 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.179065 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.179282 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.179391 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.179594 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.179901 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.180232 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.180665 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.180782 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.180932 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.181020 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.181236 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.181323 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.181560 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.181695 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.181870 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.181959 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.182173 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.182270 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.182480 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.182577 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.183358 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.183484 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.183683 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.183808 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.183999 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.184296 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.184400 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.184622 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.184756 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.184954 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.185073 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.185268 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.185385 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.185575 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.185692 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.186084 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.186217 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.186389 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.186656 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.186793 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.187010 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.187205 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.187294 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.187592 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.187705 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.188018 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.188287 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.188408 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.188738 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.188824 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.189049 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.189245 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.189352 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.189660 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.189747 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.189980 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.190214 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.190300 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.190571 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.190774 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.190870 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.191121 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.191208 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.191466 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.191586 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.191799 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.192117 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.192207 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.192497 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.192803 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.192907 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.193303 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.193841 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.193915 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.194001 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.194001 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.194147 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.194216 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.194507 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.194608 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.194826 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.195004 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.195128 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.195441 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.195527 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.195752 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.195922 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.196072 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.196371 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.196458 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.196702 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.196856 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.197018 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.197312 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.197400 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.197630 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.197789 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.197951 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.198267 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.198393 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.198685 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.199098 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.199188 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.199417 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.199726 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.199811 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.200048 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.200218 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.200370 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.200702 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.200792 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.201009 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.201319 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.201424 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.201624 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.201784 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.201927 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.202236 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.202336 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.202539 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.202727 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.202847 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.203156 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.203241 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.203464 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.203644 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.203765 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.204067 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.204151 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.204386 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.204570 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.204793 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.205027 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.205182 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.205494 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.205733 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.205834 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.206204 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.206298 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.206512 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.206701 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.206836 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.207144 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.207230 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.207447 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.207606 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.207751 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.208056 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.208167 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.208488 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.208931 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.209067 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.209234 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.209398 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.209510 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.209665 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.209805 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.210114 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.210303 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.210447 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.210762 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.210849 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.211072 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.211222 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.211388 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.211687 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.211774 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.211996 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.212159 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.212296 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.212620 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.212710 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.212924 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.213085 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.213225 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.213526 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.213620 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.213831 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.214016 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.214156 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.214455 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.214967 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.215069 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.215285 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.215451 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.215589 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.215894 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.215991 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.216199 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.216359 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.216499 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.216832 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.216920 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.217133 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.217293 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.217472 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.217733 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.217820 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.218081 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.218180 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.218479 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.218668 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.218797 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.219108 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.219206 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.219541 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.219636 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.219857 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.220021 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.220173 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.220488 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.220604 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.220830 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.220992 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.221143 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.221434 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.221532 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.221751 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.221905 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.222186 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.222343 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.222508 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.222785 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.223061 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.223208 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.223384 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.223647 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.223734 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.223991 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.224137 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.224299 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.224598 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.224688 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.224938 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.225162 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.225250 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.225534 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.225619 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.225842 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.226076 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.226164 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.226457 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.226542 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.226775 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.226996 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.227092 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.227412 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.227505 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.227727 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.227889 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.228039 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.228349 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.228441 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.228682 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.228926 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.229027 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.229337 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.229432 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.230632 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.230965 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.231065 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.231281 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.231481 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.231601 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.231916 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.232003 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.232228 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.232366 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.232544 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.232857 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.232947 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.233175 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.233320 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.233485 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.233773 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.233859 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.234097 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.234216 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.234420 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.234674 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.234761 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.235059 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.235157 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.235370 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.235574 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.235683 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.235998 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.236083 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.236431 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.236531 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.236833 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.236931 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.237164 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.237322 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.237487 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.237787 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.237881 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.238108 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.238283 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.238422 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.238749 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.238860 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.239049 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.239237 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.239351 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.239663 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.239749 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.240050 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.240207 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.240354 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.240697 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.240786 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.241009 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.241194 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.241311 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.241630 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.241716 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.241988 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.242074 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.242464 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.242550 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.242854 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.242939 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.243169 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.243359 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.243491 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.243815 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.243903 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.244131 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.244299 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.244434 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.244784 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.244871 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.245092 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.245818 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.245971 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.246296 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.246600 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.246745 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.246889 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.247198 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.247335 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.247582 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.247672 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.247934 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.248131 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.248245 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.248617 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.248711 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.249028 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.249127 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.249361 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.249546 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.249668 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.249973 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.250059 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.250276 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.250440 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.250569 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.250873 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.251015 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.251176 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.251449 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.251544 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.251766 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.251928 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.252074 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.252375 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.252459 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.252708 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.252893 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.253012 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.253319 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.253404 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.253622 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.253823 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.253920 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.254214 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.254301 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.254534 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.254711 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.254836 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.255170 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.255338 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.255477 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.255784 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.255931 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.256094 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.256342 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.256431 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.256787 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.256931 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.257137 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.257382 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.257471 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.257819 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.257972 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.258269 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.258354 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.258608 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.258696 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.258947 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.259242 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.259400 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.259554 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.259808 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.259905 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.260139 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.260327 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.260458 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.260897 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.261114 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.261694 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.262183 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.262286 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.262379 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.262654 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.262743 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.263064 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.263158 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.263399 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.263552 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.263730 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.264009 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.264095 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.264373 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.264466 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.264869 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.264960 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.265262 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.265424 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.265601 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.265847 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.265949 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.266512 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.266599 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.266842 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.266980 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.267172 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.267461 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.267680 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.267933 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.268379 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.268638 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.268638 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.268799 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.268942 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.269176 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.269672 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.269743 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.269824 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.269915 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.270183 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.270271 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.270494 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.270703 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.270822 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.271140 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.271278 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.271646 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.271732 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.272023 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.272117 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.272345 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.272496 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.272701 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.272975 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.273079 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.273345 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.273431 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.273657 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.273864 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.273984 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.274297 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.274386 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.274605 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.274883 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.274978 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.275225 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.275320 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.275539 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.275764 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.275852 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.276146 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.276241 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.276661 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.276823 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.277125 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.277560 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.277661 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.277821 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.278087 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.278244 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.278455 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.278769 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.279013 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.279110 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.279382 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.279481 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.279698 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.279898 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.279995 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.280307 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.280402 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.280638 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.280841 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.280951 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.281270 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.281414 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.281582 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.281859 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.281946 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.282191 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.282285 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.282509 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.282706 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.282802 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.283119 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.283213 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.283429 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.283567 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.283759 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.284011 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.284097 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.284409 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.284496 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.284759 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.284850 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.285079 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.285287 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.285408 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.285715 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.285815 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.286024 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.286167 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.286374 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.286599 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.286687 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.287031 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.287222 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.287460 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.287567 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.287880 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.287969 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.288218 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.288304 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.288553 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.288754 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.288908 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.289183 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.289269 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.289522 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.289620 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.289850 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.290018 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.290167 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.290455 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.290542 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.290781 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.290877 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.291096 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.291339 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.291476 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.291709 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.291804 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.292024 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.292813 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.293191 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.293351 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.293650 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.293757 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.293979 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.294148 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.294297 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.294589 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.294684 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.294916 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.295042 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.295233 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.295488 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.295574 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.295886 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.295998 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.296209 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.296358 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.296531 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.296877 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.297199 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.297330 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.297513 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.297806 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.297906 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.298131 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.298261 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.298444 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.298720 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.298806 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.299081 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.299191 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.299397 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.299641 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.299740 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.300058 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.300146 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.300421 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.300510 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.300771 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.300951 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.301095 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.301402 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.301544 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.301725 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.301902 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.302052 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.302427 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.302628 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.302794 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.302945 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.303075 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.303292 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.303408 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.303749 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.303838 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.304081 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.304178 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.304410 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.304663 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.304768 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.305041 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.305127 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.305351 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.305535 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.305665 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.305988 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.306086 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.306299 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.306428 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.306604 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.306878 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.306974 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.307206 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.307349 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.307511 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.308473 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.308891 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.308981 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.309218 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.309362 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.309533 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.309812 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.309922 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.310145 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.310239 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.310456 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.310678 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.310764 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.311061 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.311162 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.311369 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.311575 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.311703 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.311974 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.312064 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.312282 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.312487 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.312604 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.312908 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.313013 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.313218 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.313415 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.313524 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.313858 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.313943 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.314195 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.314284 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.314514 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.314792 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.314878 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.315140 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.315236 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.315467 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.315679 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.315772 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.316096 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.316202 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.316419 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.316535 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.316761 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.316913 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 19:54:16.317076 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.317410 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.317721 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.318117 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.318464 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.318779 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.319088 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.319405 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.319760 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.320069 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.320381 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.320732 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.321046 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.321369 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.321689 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.322002 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.322332 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.322647 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.322960 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.323272 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.324158 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.324483 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.324834 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.325154 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.325471 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.325795 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.326121 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.326451 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.326782 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.327098 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.327427 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.327759 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.328119 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.328437 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.328815 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.329152 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.329471 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.329788 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.330101 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 19:54:16.330346 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 19:54:16.477207 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO dbcounter [None req-a6fff654-773d-4b57-a320-5971bc3fe288 None None] Registered counter for database nova_api Aug 05 19:54:16.489701 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO dbcounter [None req-18960812-8641-4af3-a72b-5381dd099aa5 None None] Registered counter for database nova_api Aug 05 19:54:16.500753 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG oslo_db.sqlalchemy.engines [None req-a6fff654-773d-4b57-a320-5971bc3fe288 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:54:16.507411 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writer thread running {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:54:16.510414 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_db.sqlalchemy.engines [None req-18960812-8641-4af3-a72b-5381dd099aa5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:54:16.517798 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG dbcounter [-] [103463] Writer thread running {{(pid=103463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:54:16.564857 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.context [None req-a6fff654-773d-4b57-a320-5971bc3fe288 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0ecc5c16-c10c-4818-88aa-214f9c959337(cell1) {{(pid=103462) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 19:54:16.568681 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG oslo_concurrency.lockutils [None req-a6fff654-773d-4b57-a320-5971bc3fe288 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:16.569163 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG oslo_concurrency.lockutils [None req-a6fff654-773d-4b57-a320-5971bc3fe288 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:16.570720 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG oslo_concurrency.lockutils [None req-a6fff654-773d-4b57-a320-5971bc3fe288 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:16.571452 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG oslo_concurrency.lockutils [None req-a6fff654-773d-4b57-a320-5971bc3fe288 None None] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:16.571916 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG oslo_concurrency.lockutils [None req-a6fff654-773d-4b57-a320-5971bc3fe288 None None] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:16.574267 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG oslo_concurrency.lockutils [None req-a6fff654-773d-4b57-a320-5971bc3fe288 None None] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:16.576021 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.context [None req-18960812-8641-4af3-a72b-5381dd099aa5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0ecc5c16-c10c-4818-88aa-214f9c959337(cell1) {{(pid=103463) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 19:54:16.576284 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO dbcounter [None req-a6fff654-773d-4b57-a320-5971bc3fe288 None None] Registered counter for database nova_cell0 Aug 05 19:54:16.580124 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-18960812-8641-4af3-a72b-5381dd099aa5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:16.580639 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-18960812-8641-4af3-a72b-5381dd099aa5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:16.582249 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-18960812-8641-4af3-a72b-5381dd099aa5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:16.582989 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-18960812-8641-4af3-a72b-5381dd099aa5 None None] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 19:54:16.583085 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO dbcounter [None req-a6fff654-773d-4b57-a320-5971bc3fe288 None None] Registered counter for database nova_cell1 Aug 05 19:54:16.583442 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-18960812-8641-4af3-a72b-5381dd099aa5 None None] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 19:54:16.585540 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-18960812-8641-4af3-a72b-5381dd099aa5 None None] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 19:54:16.587552 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO dbcounter [None req-18960812-8641-4af3-a72b-5381dd099aa5 None None] Registered counter for database nova_cell0 Aug 05 19:54:16.591060 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG oslo_db.sqlalchemy.engines [None req-a6fff654-773d-4b57-a320-5971bc3fe288 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:54:16.592862 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG oslo_db.sqlalchemy.engines [None req-a6fff654-773d-4b57-a320-5971bc3fe288 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:54:16.594684 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO dbcounter [None req-18960812-8641-4af3-a72b-5381dd099aa5 None None] Registered counter for database nova_cell1 Aug 05 19:54:16.598546 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writer thread running {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:54:16.601439 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writer thread running {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:54:16.601597 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_db.sqlalchemy.engines [None req-18960812-8641-4af3-a72b-5381dd099aa5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:54:16.607385 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG dbcounter [-] [103463] Writer thread running {{(pid=103463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:54:16.608024 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_db.sqlalchemy.engines [None req-18960812-8641-4af3-a72b-5381dd099aa5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:54:16.750664 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO dbcounter [None req-a6fff654-773d-4b57-a320-5971bc3fe288 None None] Registered counter for database nova_cell0 Aug 05 19:54:16.760176 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG oslo_db.sqlalchemy.engines [None req-a6fff654-773d-4b57-a320-5971bc3fe288 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:54:16.765339 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writer thread running {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:54:16.765599 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG dbcounter [-] [103463] Writer thread running {{(pid=103463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:54:16.774736 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO dbcounter [None req-18960812-8641-4af3-a72b-5381dd099aa5 None None] Registered counter for database nova_cell0 Aug 05 19:54:16.784201 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_db.sqlalchemy.engines [None req-18960812-8641-4af3-a72b-5381dd099aa5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 19:54:16.788907 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG dbcounter [-] [103463] Writer thread running {{(pid=103463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 19:54:17.108390 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: WARNING keystonemiddleware.auth_token [None req-a6fff654-773d-4b57-a320-5971bc3fe288 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 19:54:17.115660 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: WARNING keystonemiddleware.auth_token [None req-a6fff654-773d-4b57-a320-5971bc3fe288 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 19:54:17.115902 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: WARNING keystonemiddleware.auth_token [None req-18960812-8641-4af3-a72b-5381dd099aa5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 19:54:17.123177 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: WARNING keystonemiddleware.auth_token [None req-18960812-8641-4af3-a72b-5381dd099aa5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 19:54:17.460130 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: WARNING keystonemiddleware.auth_token [None req-a6fff654-773d-4b57-a320-5971bc3fe288 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 19:54:17.463462 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: WARNING keystonemiddleware.auth_token [None req-18960812-8641-4af3-a72b-5381dd099aa5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 19:54:17.466186 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: WARNING keystonemiddleware.auth_token [None req-a6fff654-773d-4b57-a320-5971bc3fe288 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 19:54:17.469474 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: WARNING keystonemiddleware.auth_token [None req-18960812-8641-4af3-a72b-5381dd099aa5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 19:54:17.471427 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bd3186a9c0 pid: 103462 (default app) Aug 05 19:54:17.473554 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-a6fff654-773d-4b57-a320-5971bc3fe288 None None] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:54:17.474668 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bd3186a9c0 pid: 103463 (default app) Aug 05 19:54:17.474778 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-a6fff654-773d-4b57-a320-5971bc3fe288 None None] 10.222.0.39 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001772 Aug 05 19:54:17.475149 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 788 bytes} [Fri Aug 5 19:54:17 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:55:35.121551 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-18960812-8641-4af3-a72b-5381dd099aa5 None None] Calling method '>' {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:35.122811 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-18960812-8641-4af3-a72b-5381dd099aa5 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002059 Aug 05 19:55:35.123434 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 931 bytes} [Fri Aug 5 19:55:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:55:35.135127 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writing DB stats nova_api:SELECT=3 {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:35.136406 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writing DB stats nova_cell1:SELECT=3 {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:35.138695 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writing DB stats nova_cell0:SELECT=3 {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:35.139924 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:36.025230 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-b68cdeed-6d3f-4f02-ac33-b4e39c4315d8 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:36.057658 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-b68cdeed-6d3f-4f02-ac33-b4e39c4315d8 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.927626 Aug 05 19:55:36.058193 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 2/3] 10.222.0.39 () {60 vars in 1292 bytes} [Fri Aug 5 19:55:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:55:38.336846 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-18960812-8641-4af3-a72b-5381dd099aa5 None None] Calling method '>' {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:38.337993 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-18960812-8641-4af3-a72b-5381dd099aa5 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001622 Aug 05 19:55:38.338606 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 2/4] 10.222.0.39 () {54 vars in 931 bytes} [Fri Aug 5 19:55:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:55:38.851114 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-e22802c3-26f2-48ee-9ac5-946cafe89a41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "c1", "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 256, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:38.872323 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 19:55:38.872323 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: warnings.warn(msg) Aug 05 19:55:38.901240 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-e22802c3-26f2-48ee-9ac5-946cafe89a41 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.554596 Aug 05 19:55:38.901914 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 3/5] 10.222.0.39 () {64 vars in 1283 bytes} [Fri Aug 5 19:55:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:55:39.125888 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-ccb94a0a-2393-4704-aefa-ad3c13c09315 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:39.130236 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 19:55:39.130236 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: warnings.warn(msg) Aug 05 19:55:39.133198 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG dbcounter [-] [103463] Writing DB stats nova_api:SELECT=3 {{(pid=103463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:39.134159 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG dbcounter [-] [103463] Writing DB stats nova_cell0:SELECT=3 {{(pid=103463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:39.135111 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG dbcounter [-] [103463] Writing DB stats nova_cell1:SELECT=3 {{(pid=103463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:39.135967 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG dbcounter [-] [103463] Writing DB stats nova_cell0:SELECT=3 {{(pid=103463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:55:39.204868 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-ccb94a0a-2393-4704-aefa-ad3c13c09315 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.293137 Aug 05 19:55:39.218162 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 3/6] 10.222.0.39 () {64 vars in 1336 bytes} [Fri Aug 5 19:55:38 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:41.532756 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-e22802c3-26f2-48ee-9ac5-946cafe89a41 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:41.533825 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-e22802c3-26f2-48ee-9ac5-946cafe89a41 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 Aug 05 19:55:41.534590 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 4/7] 10.222.0.39 () {54 vars in 931 bytes} [Fri Aug 5 19:55:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:55:42.232923 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-76a0ed3e-a241-41cd-9bb4-103be54b0650 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "name": "ds512M"}} {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:42.252871 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 19:55:42.252871 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: warnings.warn(msg) Aug 05 19:55:42.275670 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-76a0ed3e-a241-41cd-9bb4-103be54b0650 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.735082 Aug 05 19:55:42.277938 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 4/8] 10.222.0.39 () {64 vars in 1283 bytes} [Fri Aug 5 19:55:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 19:55:42.289383 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-416473fd-5036-4d9f-9791-683357231aac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:42.294130 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 19:55:42.294130 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: warnings.warn(msg) Aug 05 19:55:42.334121 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-416473fd-5036-4d9f-9791-683357231aac admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048914 Aug 05 19:55:42.335103 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 5/9] 10.222.0.39 () {64 vars in 1336 bytes} [Fri Aug 5 19:55:42 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:55:44.743356 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-76a0ed3e-a241-41cd-9bb4-103be54b0650 admin admin] Calling method '>' {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:44.744383 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-76a0ed3e-a241-41cd-9bb4-103be54b0650 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 05 19:55:44.745030 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 931 bytes} [Fri Aug 5 19:55:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:55:45.115353 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-eb7cc0bf-5c62-4620-8a72-222763b76569 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "rxtx_factor": 1.0, "vcpus": 1, "id": "d2", "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "swap": 0}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:45.138482 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-eb7cc0bf-5c62-4620-8a72-222763b76569 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.387221 Aug 05 19:55:45.139034 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 6/11] 10.222.0.39 () {64 vars in 1283 bytes} [Fri Aug 5 19:55:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:55:45.151280 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-365381f0-20e7-4ffa-bc06-5326ee29ed9b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:45.175461 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-365381f0-20e7-4ffa-bc06-5326ee29ed9b admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027799 Aug 05 19:55:45.176047 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 6/12] 10.222.0.39 () {64 vars in 1336 bytes} [Fri Aug 5 19:55:45 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:55:47.453090 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-eb7cc0bf-5c62-4620-8a72-222763b76569 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:47.454096 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-eb7cc0bf-5c62-4620-8a72-222763b76569 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 05 19:55:47.454510 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 7/13] 10.222.0.39 () {54 vars in 931 bytes} [Fri Aug 5 19:55:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:55:47.904333 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-ba4146e7-e9ba-4ea3-ad93-89ce8688a2c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3", "swap": 0, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:47.923163 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-ba4146e7-e9ba-4ea3-ad93-89ce8688a2c8 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.462705 Aug 05 19:55:47.923851 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 7/14] 10.222.0.39 () {64 vars in 1283 bytes} [Fri Aug 5 19:55:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:55:47.936705 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-4528f525-74c6-44dd-9146-e5e738c07587 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:47.969484 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-4528f525-74c6-44dd-9146-e5e738c07587 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037194 Aug 05 19:55:47.970272 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 8/15] 10.222.0.39 () {64 vars in 1336 bytes} [Fri Aug 5 19:55:47 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:55:50.253212 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-ba4146e7-e9ba-4ea3-ad93-89ce8688a2c8 admin admin] Calling method '>' {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:50.254209 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-ba4146e7-e9ba-4ea3-ad93-89ce8688a2c8 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 05 19:55:50.254599 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 8/16] 10.222.0.39 () {54 vars in 931 bytes} [Fri Aug 5 19:55:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:55:50.707230 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-8caf03ac-c855-4813-9855-6d0f80afaa8a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "disk": 20, "id": "d4"}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:50.728653 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-8caf03ac-c855-4813-9855-6d0f80afaa8a admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.467759 Aug 05 19:55:50.736497 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 9/17] 10.222.0.39 () {64 vars in 1283 bytes} [Fri Aug 5 19:55:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 19:55:50.742113 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-034f2a2c-65c1-47d2-997a-a422bd795a3b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:50.770675 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-034f2a2c-65c1-47d2-997a-a422bd795a3b admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032182 Aug 05 19:55:50.771302 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 9/18] 10.222.0.39 () {64 vars in 1336 bytes} [Fri Aug 5 19:55:50 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:55:53.010389 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-8caf03ac-c855-4813-9855-6d0f80afaa8a admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:53.011397 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-8caf03ac-c855-4813-9855-6d0f80afaa8a admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 05 19:55:53.012648 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 10/19] 10.222.0.39 () {54 vars in 931 bytes} [Fri Aug 5 19:55:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 19:55:53.491266 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-0996ffab-dc5f-49cb-bc81-bb368cf83ab1 admin admin] Calling method '>' {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:53.515742 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-0996ffab-dc5f-49cb-bc81-bb368cf83ab1 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.496783 Aug 05 19:55:53.516283 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 10/20] 10.222.0.39 () {60 vars in 1292 bytes} [Fri Aug 5 19:55:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:55:55.768714 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-8caf03ac-c855-4813-9855-6d0f80afaa8a admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:55.769692 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-8caf03ac-c855-4813-9855-6d0f80afaa8a admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Aug 05 19:55:55.770099 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 11/21] 10.222.0.39 () {54 vars in 931 bytes} [Fri Aug 5 19:55:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:55:56.217131 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-e0cf7f85-c655-4f82-b418-448c0636eade admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "name": "m1.tiny"}} {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:56.237319 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-e0cf7f85-c655-4f82-b418-448c0636eade admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.459490 Aug 05 19:55:56.237850 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 11/22] 10.222.0.39 () {64 vars in 1283 bytes} [Fri Aug 5 19:55:55 2022] POST /compute/v2.1/flavors => generated 402 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:55:56.250753 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-3d876b66-f587-4789-ac44-e02fa74273ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:56.275241 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-3d876b66-f587-4789-ac44-e02fa74273ac admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028598 Aug 05 19:55:56.275834 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 12/23] 10.222.0.39 () {64 vars in 1333 bytes} [Fri Aug 5 19:55:56 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 19:55:58.562331 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-e0cf7f85-c655-4f82-b418-448c0636eade admin admin] Calling method '>' {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:55:58.563384 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-e0cf7f85-c655-4f82-b418-448c0636eade admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 05 19:55:58.563788 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 12/24] 10.222.0.39 () {54 vars in 931 bytes} [Fri Aug 5 19:55:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:55:58.995718 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-7360de1a-095e-43e5-9a25-b1062788f244 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0, "id": "2", "vcpus": 1, "disk": 20, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:59.016419 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-7360de1a-095e-43e5-9a25-b1062788f244 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.446439 Aug 05 19:55:59.017025 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 13/25] 10.222.0.39 () {64 vars in 1283 bytes} [Fri Aug 5 19:55:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:55:59.030491 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-c1306b4d-8dcb-4e4e-9a44-e266270b38f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:55:59.055586 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-c1306b4d-8dcb-4e4e-9a44-e266270b38f3 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029170 Aug 05 19:55:59.056174 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 13/26] 10.222.0.39 () {64 vars in 1333 bytes} [Fri Aug 5 19:55:59 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:01.476323 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-7360de1a-095e-43e5-9a25-b1062788f244 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:01.477395 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-7360de1a-095e-43e5-9a25-b1062788f244 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Aug 05 19:56:01.477841 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 14/27] 10.222.0.39 () {54 vars in 931 bytes} [Fri Aug 5 19:56:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:01.939382 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-e7e61e55-3b26-4cf2-a90d-9992323bfb56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "name": "m1.medium", "swap": 0, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:01.960340 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-e7e61e55-3b26-4cf2-a90d-9992323bfb56 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.474840 Aug 05 19:56:01.960935 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 14/28] 10.222.0.39 () {64 vars in 1283 bytes} [Fri Aug 5 19:56:01 2022] POST /compute/v2.1/flavors => generated 406 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:56:01.974351 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-2fd1a412-9bf7-4e41-80c2-48a6b38d3fd1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:01.999391 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-2fd1a412-9bf7-4e41-80c2-48a6b38d3fd1 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029247 Aug 05 19:56:02.000026 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 15/29] 10.222.0.39 () {64 vars in 1333 bytes} [Fri Aug 5 19:56:01 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:04.350094 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-e7e61e55-3b26-4cf2-a90d-9992323bfb56 admin admin] Calling method '>' {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:04.351050 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-e7e61e55-3b26-4cf2-a90d-9992323bfb56 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 05 19:56:04.351451 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 15/30] 10.222.0.39 () {54 vars in 931 bytes} [Fri Aug 5 19:56:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:04.850800 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-8991facb-770c-4567-9094-9564071f923b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 8192, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "disk": 80, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:04.870576 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-8991facb-770c-4567-9094-9564071f923b admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.512526 Aug 05 19:56:04.871293 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 16/31] 10.222.0.39 () {64 vars in 1283 bytes} [Fri Aug 5 19:56:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:56:04.883797 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-bb8208cd-1e38-4fe1-b988-bf7308ab9477 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:04.909318 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-bb8208cd-1e38-4fe1-b988-bf7308ab9477 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029152 Aug 05 19:56:04.910015 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 16/32] 10.222.0.39 () {64 vars in 1333 bytes} [Fri Aug 5 19:56:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:07.188947 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-8991facb-770c-4567-9094-9564071f923b admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:07.189966 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-8991facb-770c-4567-9094-9564071f923b admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 05 19:56:07.190383 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 17/33] 10.222.0.39 () {54 vars in 931 bytes} [Fri Aug 5 19:56:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:07.660878 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-ee5c7fc0-2981-49d0-859a-ace4660c27c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 16384, "vcpus": 8, "name": "m1.xlarge", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:07.681380 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-ee5c7fc0-2981-49d0-859a-ace4660c27c9 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.484540 Aug 05 19:56:07.682049 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 17/34] 10.222.0.39 () {64 vars in 1283 bytes} [Fri Aug 5 19:56:07 2022] POST /compute/v2.1/flavors => generated 408 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:56:07.694680 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-dd0ed1d0-808a-4c2e-8645-da7dbd4701e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:07.700394 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:07.724636 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-dd0ed1d0-808a-4c2e-8645-da7dbd4701e5 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033816 Aug 05 19:56:07.736604 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 18/35] 10.222.0.39 () {64 vars in 1333 bytes} [Fri Aug 5 19:56:07 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:56:28.717856 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-ee5c7fc0-2981-49d0-859a-ace4660c27c9 admin admin] Calling method '>' {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:28.718861 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-ee5c7fc0-2981-49d0-859a-ace4660c27c9 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 05 19:56:28.719254 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 18/36] 10.222.0.39 () {54 vars in 931 bytes} [Fri Aug 5 19:56:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:29.119078 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-c9572179-aa63-4671-881c-158101e37a1d admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:29.137786 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-c9572179-aa63-4671-881c-158101e37a1d admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.412149 Aug 05 19:56:29.138312 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 19/37] 10.222.0.39 () {60 vars in 1292 bytes} [Fri Aug 5 19:56:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 19:56:30.357915 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-ee5c7fc0-2981-49d0-859a-ace4660c27c9 admin admin] Calling method '>' {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:30.358928 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-ee5c7fc0-2981-49d0-859a-ace4660c27c9 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Aug 05 19:56:30.359327 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 19/38] 10.222.0.39 () {56 vars in 1074 bytes} [Fri Aug 5 19:56:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:30.898078 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-7b7d074a-b9f7-4050-9685-6b302f6fbc60 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:30.903962 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.wsgi [None req-7b7d074a-b9f7-4050-9685-6b302f6fbc60 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 05 19:56:30.907251 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-7b7d074a-b9f7-4050-9685-6b302f6fbc60 admin admin] Request method failure captured: Aug 05 19:56:30.907251 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 05 19:56:30.907251 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: Accept: application/json Aug 05 19:56:30.907251 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: Accept-Encoding: gzip, deflate Aug 05 19:56:30.907251 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: Connection: keep-alive Aug 05 19:56:30.907251 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: Content-Length: 0 Aug 05 19:56:30.907251 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: Host: 10.222.0.39 Aug 05 19:56:30.907251 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: Openstack-Api-Version: compute 2.90 Aug 05 19:56:30.907251 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: Openstack-System-Scope: None Aug 05 19:56:30.907251 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: User-Agent: python-novaclient Aug 05 19:56:30.907251 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Auth-Token: gAAAAABi7XXuLgnzLzkROC2Hv5yAJSW4VnRPAZXczTFoPHH-9l28tAHeMFqZgxAuMn7Ce93ckNtAPM4kXsR8iSBTknOGEosVlvZjKyLT8O04FVgJp2lXyfkOTC_LYINSBpqRcxNA73oiEqUTiXP1LXmrXbiP0PjRRK8iwVmXNoZqbtKvprmlVbY Aug 05 19:56:30.907251 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Domain-Id: None Aug 05 19:56:30.907251 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Domain-Name: None Aug 05 19:56:30.907251 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Identity-Status: Confirmed Aug 05 19:56:30.907251 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Is-Admin-Project: True Aug 05 19:56:30.907251 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 19:56:30.907251 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Project-Domain-Id: default Aug 05 19:56:30.907251 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Project-Domain-Name: Default Aug 05 19:56:30.907251 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Project-Id: 9bb3822e6d1c4f82815dbeda0f6eff52 Aug 05 19:56:30.907251 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Project-Name: admin Aug 05 19:56:30.907251 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Role: reader,member,admin Aug 05 19:56:30.907251 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Roles: reader,member,admin Aug 05 19:56:30.908797 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9bb3822e6d1c4f82815dbeda0f6eff52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9bb3822e6d1c4f82815dbeda0f6eff52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9bb3822e6d1c4f82815dbeda0f6eff52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9bb3822e6d1c4f82815dbeda0f6eff52", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 19:56:30.908797 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Tenant: admin Aug 05 19:56:30.908797 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Tenant-Id: 9bb3822e6d1c4f82815dbeda0f6eff52 Aug 05 19:56:30.908797 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Tenant-Name: admin Aug 05 19:56:30.908797 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-User: admin Aug 05 19:56:30.908797 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-User-Domain-Id: default Aug 05 19:56:30.908797 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-User-Domain-Name: Default Aug 05 19:56:30.908797 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-User-Id: 88c3879e2d344041935d28c7f22fdeeb Aug 05 19:56:30.908797 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-User-Name: admin Aug 05 19:56:30.908797 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: method: > Aug 05 19:56:30.908797 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: exception: Flavor 42 could not be found. Aug 05 19:56:30.908797 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: action_args: {'id': '42'} Aug 05 19:56:30.908797 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:56:30.908797 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:30.909662 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 19:56:30.909662 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 19:56:30.909662 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 19:56:30.909662 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 19:56:30.909662 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 19:56:30.909662 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 19:56:30.909662 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 19:56:30.909662 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 19:56:30.909662 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 19:56:30.909662 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:56:30.909662 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 19:56:30.909662 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 19:56:30.909662 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 05 19:56:30.909662 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 05 19:56:30.909662 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:30.909662 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 05 19:56:30.909662 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:30.909662 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:56:30.909662 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:56:30.910812 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:56:30.910812 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:56:30.910812 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:56:30.910812 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:56:30.910812 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 19:56:30.910812 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:56:30.910812 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 05 19:56:30.910812 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 05 19:56:30.910812 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:30.910812 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 05 19:56:30.910812 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:30.910812 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:56:30.910812 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:56:30.910812 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:56:30.910812 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:56:30.910812 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 05 19:56:30.910812 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 05 19:56:30.910812 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-7b7d074a-b9f7-4050-9685-6b302f6fbc60 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:56:30.911842 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-7b7d074a-b9f7-4050-9685-6b302f6fbc60 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.407493 Aug 05 19:56:30.911842 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 20/39] 10.222.0.39 () {60 vars in 1190 bytes} [Fri Aug 5 19:56:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 409 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 19:56:30.918760 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-22a0d256-5473-4ba7-a9bc-3a080ce26b3b admin admin] Calling method '>' {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:30.922903 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG dbcounter [-] [103463] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:56:30.942914 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-22a0d256-5473-4ba7-a9bc-3a080ce26b3b admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028083 Aug 05 19:56:30.943619 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 20/40] 10.222.0.39 () {60 vars in 1210 bytes} [Fri Aug 5 19:56:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:30.954370 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-59291f20-ec97-4daa-b6cf-c220314e04e7 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:30.978487 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-59291f20-ec97-4daa-b6cf-c220314e04e7 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027726 Aug 05 19:56:30.979038 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 21/41] 10.222.0.39 () {60 vars in 1210 bytes} [Fri Aug 5 19:56:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:30.989542 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-104b1e99-78a0-406c-a807-92fb41b34f8f admin admin] Calling method '>' {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:30.996432 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.wsgi [None req-104b1e99-78a0-406c-a807-92fb41b34f8f admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 05 19:56:31.000198 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-104b1e99-78a0-406c-a807-92fb41b34f8f admin admin] Request method failure captured: Aug 05 19:56:31.000198 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 05 19:56:31.000198 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: Accept: application/json Aug 05 19:56:31.000198 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: Accept-Encoding: gzip, deflate Aug 05 19:56:31.000198 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: Connection: keep-alive Aug 05 19:56:31.000198 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: Content-Length: 0 Aug 05 19:56:31.000198 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: Host: 10.222.0.39 Aug 05 19:56:31.000198 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: Openstack-Api-Version: compute 2.90 Aug 05 19:56:31.000198 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: Openstack-System-Scope: None Aug 05 19:56:31.000198 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: User-Agent: python-novaclient Aug 05 19:56:31.000198 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Auth-Token: gAAAAABi7XXuLgnzLzkROC2Hv5yAJSW4VnRPAZXczTFoPHH-9l28tAHeMFqZgxAuMn7Ce93ckNtAPM4kXsR8iSBTknOGEosVlvZjKyLT8O04FVgJp2lXyfkOTC_LYINSBpqRcxNA73oiEqUTiXP1LXmrXbiP0PjRRK8iwVmXNoZqbtKvprmlVbY Aug 05 19:56:31.000198 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Domain-Id: None Aug 05 19:56:31.000198 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Domain-Name: None Aug 05 19:56:31.000198 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Identity-Status: Confirmed Aug 05 19:56:31.000198 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Is-Admin-Project: True Aug 05 19:56:31.000198 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 19:56:31.000198 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Project-Domain-Id: default Aug 05 19:56:31.000198 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Project-Domain-Name: Default Aug 05 19:56:31.000198 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Project-Id: 9bb3822e6d1c4f82815dbeda0f6eff52 Aug 05 19:56:31.000198 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Project-Name: admin Aug 05 19:56:31.000198 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Role: reader,member,admin Aug 05 19:56:31.000198 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Roles: reader,member,admin Aug 05 19:56:31.001801 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9bb3822e6d1c4f82815dbeda0f6eff52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9bb3822e6d1c4f82815dbeda0f6eff52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9bb3822e6d1c4f82815dbeda0f6eff52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9bb3822e6d1c4f82815dbeda0f6eff52", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 19:56:31.001801 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Tenant: admin Aug 05 19:56:31.001801 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Tenant-Id: 9bb3822e6d1c4f82815dbeda0f6eff52 Aug 05 19:56:31.001801 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Tenant-Name: admin Aug 05 19:56:31.001801 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-User: admin Aug 05 19:56:31.001801 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-User-Domain-Id: default Aug 05 19:56:31.001801 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-User-Domain-Name: Default Aug 05 19:56:31.001801 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-User-Id: 88c3879e2d344041935d28c7f22fdeeb Aug 05 19:56:31.001801 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-User-Name: admin Aug 05 19:56:31.001801 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: method: > Aug 05 19:56:31.001801 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: exception: Flavor 42 could not be found. Aug 05 19:56:31.001801 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: action_args: {'id': '42'} Aug 05 19:56:31.001801 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:56:31.001801 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:31.002739 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 19:56:31.002739 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 19:56:31.002739 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 19:56:31.002739 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 19:56:31.002739 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 19:56:31.002739 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 19:56:31.002739 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 19:56:31.002739 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 19:56:31.002739 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 19:56:31.002739 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:56:31.002739 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 19:56:31.002739 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 19:56:31.002739 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 05 19:56:31.002739 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi Aug 05 19:56:31.002739 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:31.002739 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi Aug 05 19:56:31.002739 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:31.002739 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:56:31.002739 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:56:31.004023 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:56:31.004023 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:56:31.004023 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:56:31.004023 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:56:31.004023 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 19:56:31.004023 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:56:31.004023 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 05 19:56:31.004023 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi Aug 05 19:56:31.004023 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:31.004023 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi Aug 05 19:56:31.004023 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:31.004023 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:56:31.004023 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:56:31.004023 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:56:31.004023 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:56:31.004023 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 05 19:56:31.004023 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi Aug 05 19:56:31.004023 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-104b1e99-78a0-406c-a807-92fb41b34f8f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:56:31.005354 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-104b1e99-78a0-406c-a807-92fb41b34f8f admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016227 Aug 05 19:56:31.005354 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 21/42] 10.222.0.39 () {60 vars in 1190 bytes} [Fri Aug 5 19:56:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 19:56:31.986578 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-59291f20-ec97-4daa-b6cf-c220314e04e7 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:31.987589 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-59291f20-ec97-4daa-b6cf-c220314e04e7 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 05 19:56:31.988019 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 22/43] 10.222.0.39 () {56 vars in 1074 bytes} [Fri Aug 5 19:56:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:32.517154 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-a564657f-a4a4-46d0-9545-bc2d499844f6 admin admin] Calling method '>' {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:32.523456 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.wsgi [None req-a564657f-a4a4-46d0-9545-bc2d499844f6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 05 19:56:32.525067 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-a564657f-a4a4-46d0-9545-bc2d499844f6 admin admin] Request method failure captured: Aug 05 19:56:32.525067 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 05 19:56:32.525067 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: Accept: application/json Aug 05 19:56:32.525067 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: Accept-Encoding: gzip, deflate Aug 05 19:56:32.525067 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: Connection: keep-alive Aug 05 19:56:32.525067 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: Content-Length: 0 Aug 05 19:56:32.525067 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: Host: 10.222.0.39 Aug 05 19:56:32.525067 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: Openstack-Api-Version: compute 2.90 Aug 05 19:56:32.525067 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: Openstack-System-Scope: None Aug 05 19:56:32.525067 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: User-Agent: python-novaclient Aug 05 19:56:32.525067 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Auth-Token: gAAAAABi7XXvGyg09dA450LVSR5guIWl6FAcaIv17TMemDsPc7Ip1Si7Z5SnfSCAMtVZ1y-viunnvzXfKBmjdN1HjTARMyAC86HrnNXVrxl0ZAaGFL4ZlbA2FmkFhfPKQSgE0ONlPF0-0OxlzAVmeXUrPjJrKCQzpx-qgUwJ64x2pNqXfdbcBVM Aug 05 19:56:32.525067 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Domain-Id: None Aug 05 19:56:32.525067 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Domain-Name: None Aug 05 19:56:32.525067 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Identity-Status: Confirmed Aug 05 19:56:32.525067 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Is-Admin-Project: True Aug 05 19:56:32.525067 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 19:56:32.525067 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Project-Domain-Id: default Aug 05 19:56:32.525067 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Project-Domain-Name: Default Aug 05 19:56:32.525067 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Project-Id: 9bb3822e6d1c4f82815dbeda0f6eff52 Aug 05 19:56:32.525067 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Project-Name: admin Aug 05 19:56:32.525067 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Role: reader,member,admin Aug 05 19:56:32.525067 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Roles: reader,member,admin Aug 05 19:56:32.526463 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9bb3822e6d1c4f82815dbeda0f6eff52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9bb3822e6d1c4f82815dbeda0f6eff52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9bb3822e6d1c4f82815dbeda0f6eff52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9bb3822e6d1c4f82815dbeda0f6eff52", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 19:56:32.526463 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Tenant: admin Aug 05 19:56:32.526463 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Tenant-Id: 9bb3822e6d1c4f82815dbeda0f6eff52 Aug 05 19:56:32.526463 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Tenant-Name: admin Aug 05 19:56:32.526463 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-User: admin Aug 05 19:56:32.526463 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-User-Domain-Id: default Aug 05 19:56:32.526463 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-User-Domain-Name: Default Aug 05 19:56:32.526463 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-User-Id: 88c3879e2d344041935d28c7f22fdeeb Aug 05 19:56:32.526463 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-User-Name: admin Aug 05 19:56:32.526463 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: method: > Aug 05 19:56:32.526463 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: exception: Flavor 84 could not be found. Aug 05 19:56:32.526463 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: action_args: {'id': '84'} Aug 05 19:56:32.526463 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:56:32.526463 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:32.528471 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 19:56:32.528471 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 19:56:32.528471 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 19:56:32.528471 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 19:56:32.528471 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 19:56:32.528471 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 19:56:32.528471 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 19:56:32.528471 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 19:56:32.528471 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 19:56:32.528471 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:56:32.528471 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 19:56:32.528471 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 19:56:32.528471 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 05 19:56:32.528471 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi Aug 05 19:56:32.528471 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:32.528471 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi Aug 05 19:56:32.528471 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:32.528471 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:56:32.528471 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:56:32.529816 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:56:32.529816 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:56:32.529816 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:56:32.529816 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:56:32.529816 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 19:56:32.529816 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:56:32.529816 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 05 19:56:32.529816 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi Aug 05 19:56:32.529816 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:32.529816 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi Aug 05 19:56:32.529816 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:32.529816 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:56:32.529816 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:56:32.529816 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:56:32.529816 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:56:32.529816 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 05 19:56:32.529816 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi Aug 05 19:56:32.529816 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-a564657f-a4a4-46d0-9545-bc2d499844f6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:56:32.531108 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-a564657f-a4a4-46d0-9545-bc2d499844f6 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.400532 Aug 05 19:56:32.531108 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 22/44] 10.222.0.39 () {60 vars in 1190 bytes} [Fri Aug 5 19:56:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 19:56:32.536190 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-7d432792-4f6d-43ee-ac60-35ae00b9db7c admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:32.552515 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-7d432792-4f6d-43ee-ac60-35ae00b9db7c admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019969 Aug 05 19:56:32.553113 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 23/45] 10.222.0.39 () {60 vars in 1210 bytes} [Fri Aug 5 19:56:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:32.563375 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-f827f6f4-5cf0-477c-b20a-6e9766f27091 admin admin] Calling method '>' {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:32.580405 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-f827f6f4-5cf0-477c-b20a-6e9766f27091 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020505 Aug 05 19:56:32.580994 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 23/46] 10.222.0.39 () {60 vars in 1210 bytes} [Fri Aug 5 19:56:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:32.590596 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-2a911bbe-ddf9-4a56-8607-1fd0cefa65de admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:32.596007 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.wsgi [None req-2a911bbe-ddf9-4a56-8607-1fd0cefa65de admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 05 19:56:32.597544 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-2a911bbe-ddf9-4a56-8607-1fd0cefa65de admin admin] Request method failure captured: Aug 05 19:56:32.597544 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 05 19:56:32.597544 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: Accept: application/json Aug 05 19:56:32.597544 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: Accept-Encoding: gzip, deflate Aug 05 19:56:32.597544 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: Connection: keep-alive Aug 05 19:56:32.597544 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: Content-Length: 0 Aug 05 19:56:32.597544 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: Host: 10.222.0.39 Aug 05 19:56:32.597544 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: Openstack-Api-Version: compute 2.90 Aug 05 19:56:32.597544 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: Openstack-System-Scope: None Aug 05 19:56:32.597544 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: User-Agent: python-novaclient Aug 05 19:56:32.597544 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Auth-Token: gAAAAABi7XXvGyg09dA450LVSR5guIWl6FAcaIv17TMemDsPc7Ip1Si7Z5SnfSCAMtVZ1y-viunnvzXfKBmjdN1HjTARMyAC86HrnNXVrxl0ZAaGFL4ZlbA2FmkFhfPKQSgE0ONlPF0-0OxlzAVmeXUrPjJrKCQzpx-qgUwJ64x2pNqXfdbcBVM Aug 05 19:56:32.597544 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Domain-Id: None Aug 05 19:56:32.597544 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Domain-Name: None Aug 05 19:56:32.597544 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Identity-Status: Confirmed Aug 05 19:56:32.597544 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Is-Admin-Project: True Aug 05 19:56:32.597544 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 19:56:32.597544 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Project-Domain-Id: default Aug 05 19:56:32.597544 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Project-Domain-Name: Default Aug 05 19:56:32.597544 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Project-Id: 9bb3822e6d1c4f82815dbeda0f6eff52 Aug 05 19:56:32.597544 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Project-Name: admin Aug 05 19:56:32.597544 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Role: reader,member,admin Aug 05 19:56:32.597544 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Roles: reader,member,admin Aug 05 19:56:32.598847 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9bb3822e6d1c4f82815dbeda0f6eff52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9bb3822e6d1c4f82815dbeda0f6eff52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9bb3822e6d1c4f82815dbeda0f6eff52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9bb3822e6d1c4f82815dbeda0f6eff52", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 19:56:32.598847 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Tenant: admin Aug 05 19:56:32.598847 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Tenant-Id: 9bb3822e6d1c4f82815dbeda0f6eff52 Aug 05 19:56:32.598847 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Tenant-Name: admin Aug 05 19:56:32.598847 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-User: admin Aug 05 19:56:32.598847 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-User-Domain-Id: default Aug 05 19:56:32.598847 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-User-Domain-Name: Default Aug 05 19:56:32.598847 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-User-Id: 88c3879e2d344041935d28c7f22fdeeb Aug 05 19:56:32.598847 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-User-Name: admin Aug 05 19:56:32.598847 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: method: > Aug 05 19:56:32.598847 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: exception: Flavor 84 could not be found. Aug 05 19:56:32.598847 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: action_args: {'id': '84'} Aug 05 19:56:32.598847 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:56:32.598847 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:32.599640 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 19:56:32.599640 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 19:56:32.599640 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 19:56:32.599640 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 19:56:32.599640 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 19:56:32.599640 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 19:56:32.599640 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 19:56:32.599640 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 19:56:32.599640 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 19:56:32.599640 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:56:32.599640 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 19:56:32.599640 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 19:56:32.599640 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 05 19:56:32.599640 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 05 19:56:32.599640 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:32.599640 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 05 19:56:32.599640 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:32.599640 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:56:32.599640 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:56:32.601151 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:56:32.601151 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:56:32.601151 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:56:32.601151 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:56:32.601151 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 19:56:32.601151 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:56:32.601151 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 05 19:56:32.601151 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 05 19:56:32.601151 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:32.601151 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 05 19:56:32.601151 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:32.601151 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:56:32.601151 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:56:32.601151 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:56:32.601151 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:56:32.601151 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 05 19:56:32.601151 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 05 19:56:32.601151 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-2a911bbe-ddf9-4a56-8607-1fd0cefa65de admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:56:32.602399 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-2a911bbe-ddf9-4a56-8607-1fd0cefa65de admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011942 Aug 05 19:56:32.602399 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 24/47] 10.222.0.39 () {60 vars in 1190 bytes} [Fri Aug 5 19:56:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 19:56:33.569405 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-f827f6f4-5cf0-477c-b20a-6e9766f27091 admin admin] Calling method '>' {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:33.570414 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-f827f6f4-5cf0-477c-b20a-6e9766f27091 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Aug 05 19:56:33.570926 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 24/48] 10.222.0.39 () {56 vars in 1074 bytes} [Fri Aug 5 19:56:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:34.104130 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-615f7534-20bc-456f-a720-caf3bfe2fcf6 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:34.111037 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.wsgi [None req-615f7534-20bc-456f-a720-caf3bfe2fcf6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 05 19:56:34.112542 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-615f7534-20bc-456f-a720-caf3bfe2fcf6 admin admin] Request method failure captured: Aug 05 19:56:34.112542 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 05 19:56:34.112542 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: Accept: application/json Aug 05 19:56:34.112542 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: Accept-Encoding: gzip, deflate Aug 05 19:56:34.112542 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: Connection: keep-alive Aug 05 19:56:34.112542 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: Content-Length: 0 Aug 05 19:56:34.112542 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: Host: 10.222.0.39 Aug 05 19:56:34.112542 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: Openstack-Api-Version: compute 2.90 Aug 05 19:56:34.112542 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: Openstack-System-Scope: None Aug 05 19:56:34.112542 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: User-Agent: python-novaclient Aug 05 19:56:34.112542 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Auth-Token: gAAAAABi7XXxpKZTFct6WGy94z65VOgsEYHGfYwBZXAHGay3rUF_WUjNAAK72xG1XUs68aRPCghbp5f1SZwV5G7mfgZAVPukQhy01iiAc8ulNJoP0Aezo4s5tUrMtH4zUrEfAIDUy8NanKrsnB6piDSFFALOQ8ZWlqTBP2srH5KW2oaQ7ZA9oyo Aug 05 19:56:34.112542 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Domain-Id: None Aug 05 19:56:34.112542 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Domain-Name: None Aug 05 19:56:34.112542 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Identity-Status: Confirmed Aug 05 19:56:34.112542 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Is-Admin-Project: True Aug 05 19:56:34.112542 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 19:56:34.112542 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Project-Domain-Id: default Aug 05 19:56:34.112542 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Project-Domain-Name: Default Aug 05 19:56:34.112542 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Project-Id: 9bb3822e6d1c4f82815dbeda0f6eff52 Aug 05 19:56:34.112542 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Project-Name: admin Aug 05 19:56:34.112542 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Role: reader,member,admin Aug 05 19:56:34.112542 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Roles: reader,member,admin Aug 05 19:56:34.114161 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9bb3822e6d1c4f82815dbeda0f6eff52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9bb3822e6d1c4f82815dbeda0f6eff52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9bb3822e6d1c4f82815dbeda0f6eff52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9bb3822e6d1c4f82815dbeda0f6eff52", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 19:56:34.114161 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Tenant: admin Aug 05 19:56:34.114161 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Tenant-Id: 9bb3822e6d1c4f82815dbeda0f6eff52 Aug 05 19:56:34.114161 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-Tenant-Name: admin Aug 05 19:56:34.114161 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-User: admin Aug 05 19:56:34.114161 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-User-Domain-Id: default Aug 05 19:56:34.114161 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-User-Domain-Name: Default Aug 05 19:56:34.114161 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-User-Id: 88c3879e2d344041935d28c7f22fdeeb Aug 05 19:56:34.114161 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: X-User-Name: admin Aug 05 19:56:34.114161 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: method: > Aug 05 19:56:34.114161 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: exception: Flavor 451 could not be found. Aug 05 19:56:34.114161 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: action_args: {'id': '451'} Aug 05 19:56:34.114161 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:56:34.114161 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:34.115036 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 19:56:34.115036 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 19:56:34.115036 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 19:56:34.115036 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 19:56:34.115036 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 19:56:34.115036 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 19:56:34.115036 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 19:56:34.115036 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 19:56:34.115036 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 19:56:34.115036 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:56:34.115036 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 19:56:34.115036 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 19:56:34.115036 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 05 19:56:34.115036 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 05 19:56:34.115036 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:34.115036 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 05 19:56:34.115036 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:34.115036 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:56:34.115036 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:56:34.116081 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:56:34.116081 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:56:34.116081 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:56:34.116081 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:56:34.116081 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 19:56:34.116081 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:56:34.116081 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 05 19:56:34.116081 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 05 19:56:34.116081 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:34.116081 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 05 19:56:34.116081 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:34.116081 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:56:34.116081 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:56:34.116081 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:56:34.116081 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:56:34.116081 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 05 19:56:34.116081 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: ERROR nova.api.openstack.wsgi Aug 05 19:56:34.116081 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-615f7534-20bc-456f-a720-caf3bfe2fcf6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:56:34.117519 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-615f7534-20bc-456f-a720-caf3bfe2fcf6 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.405419 Aug 05 19:56:34.117519 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 25/49] 10.222.0.39 () {60 vars in 1193 bytes} [Fri Aug 5 19:56:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 19:56:34.124651 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-8da440e1-ee44-432c-8a9c-5923cfa41dfb admin admin] Calling method '>' {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:34.139870 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-8da440e1-ee44-432c-8a9c-5923cfa41dfb admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019644 Aug 05 19:56:34.140420 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 25/50] 10.222.0.39 () {60 vars in 1210 bytes} [Fri Aug 5 19:56:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:34.150360 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-e886b4ff-aab6-422f-8241-276cdd53d9fe admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:34.165960 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-e886b4ff-aab6-422f-8241-276cdd53d9fe admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019410 Aug 05 19:56:34.166502 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 26/51] 10.222.0.39 () {60 vars in 1210 bytes} [Fri Aug 5 19:56:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:56:34.176527 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-2c6cad1d-aaa0-4899-99f8-917bb5653c48 admin admin] Calling method '>' {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:34.181998 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.wsgi [None req-2c6cad1d-aaa0-4899-99f8-917bb5653c48 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 05 19:56:34.184272 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-2c6cad1d-aaa0-4899-99f8-917bb5653c48 admin admin] Request method failure captured: Aug 05 19:56:34.184272 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 05 19:56:34.184272 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: Accept: application/json Aug 05 19:56:34.184272 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: Accept-Encoding: gzip, deflate Aug 05 19:56:34.184272 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: Connection: keep-alive Aug 05 19:56:34.184272 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: Content-Length: 0 Aug 05 19:56:34.184272 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: Host: 10.222.0.39 Aug 05 19:56:34.184272 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: Openstack-Api-Version: compute 2.90 Aug 05 19:56:34.184272 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: Openstack-System-Scope: None Aug 05 19:56:34.184272 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: User-Agent: python-novaclient Aug 05 19:56:34.184272 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Auth-Token: gAAAAABi7XXxpKZTFct6WGy94z65VOgsEYHGfYwBZXAHGay3rUF_WUjNAAK72xG1XUs68aRPCghbp5f1SZwV5G7mfgZAVPukQhy01iiAc8ulNJoP0Aezo4s5tUrMtH4zUrEfAIDUy8NanKrsnB6piDSFFALOQ8ZWlqTBP2srH5KW2oaQ7ZA9oyo Aug 05 19:56:34.184272 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Domain-Id: None Aug 05 19:56:34.184272 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Domain-Name: None Aug 05 19:56:34.184272 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Identity-Status: Confirmed Aug 05 19:56:34.184272 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Is-Admin-Project: True Aug 05 19:56:34.184272 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 19:56:34.184272 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Project-Domain-Id: default Aug 05 19:56:34.184272 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Project-Domain-Name: Default Aug 05 19:56:34.184272 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Project-Id: 9bb3822e6d1c4f82815dbeda0f6eff52 Aug 05 19:56:34.184272 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Project-Name: admin Aug 05 19:56:34.184272 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Role: reader,member,admin Aug 05 19:56:34.184272 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Roles: reader,member,admin Aug 05 19:56:34.186763 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9bb3822e6d1c4f82815dbeda0f6eff52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9bb3822e6d1c4f82815dbeda0f6eff52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9bb3822e6d1c4f82815dbeda0f6eff52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9bb3822e6d1c4f82815dbeda0f6eff52", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 19:56:34.186763 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Tenant: admin Aug 05 19:56:34.186763 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Tenant-Id: 9bb3822e6d1c4f82815dbeda0f6eff52 Aug 05 19:56:34.186763 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-Tenant-Name: admin Aug 05 19:56:34.186763 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-User: admin Aug 05 19:56:34.186763 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-User-Domain-Id: default Aug 05 19:56:34.186763 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-User-Domain-Name: Default Aug 05 19:56:34.186763 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-User-Id: 88c3879e2d344041935d28c7f22fdeeb Aug 05 19:56:34.186763 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: X-User-Name: admin Aug 05 19:56:34.186763 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: method: > Aug 05 19:56:34.186763 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: exception: Flavor 451 could not be found. Aug 05 19:56:34.186763 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: action_args: {'id': '451'} Aug 05 19:56:34.186763 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 19:56:34.186763 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:34.188627 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 19:56:34.188627 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 19:56:34.188627 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 19:56:34.188627 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 19:56:34.188627 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 19:56:34.188627 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 19:56:34.188627 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 19:56:34.188627 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 19:56:34.188627 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 19:56:34.188627 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:56:34.188627 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 19:56:34.188627 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 19:56:34.188627 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 05 19:56:34.188627 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi Aug 05 19:56:34.188627 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:34.188627 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi Aug 05 19:56:34.188627 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:34.188627 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:56:34.188627 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:56:34.190871 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 19:56:34.190871 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 19:56:34.190871 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 19:56:34.190871 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 19:56:34.190871 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 19:56:34.190871 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 19:56:34.190871 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 05 19:56:34.190871 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi Aug 05 19:56:34.190871 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 19:56:34.190871 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi Aug 05 19:56:34.190871 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 19:56:34.190871 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 19:56:34.190871 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 19:56:34.190871 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 19:56:34.190871 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 19:56:34.190871 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 05 19:56:34.190871 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: ERROR nova.api.openstack.wsgi Aug 05 19:56:34.190871 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-2c6cad1d-aaa0-4899-99f8-917bb5653c48 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 19:56:34.193155 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-2c6cad1d-aaa0-4899-99f8-917bb5653c48 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012830 Aug 05 19:56:34.193155 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 26/52] 10.222.0.39 () {60 vars in 1193 bytes} [Fri Aug 5 19:56:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 19:56:35.187526 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-e886b4ff-aab6-422f-8241-276cdd53d9fe admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:35.188540 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-e886b4ff-aab6-422f-8241-276cdd53d9fe admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 05 19:56:35.188978 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 27/53] 10.222.0.39 () {56 vars in 1074 bytes} [Fri Aug 5 19:56:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:35.731255 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-3a3b3d3f-0a16-43a8-86ac-fa75738f8e79 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:35.750555 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-3a3b3d3f-0a16-43a8-86ac-fa75738f8e79 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.413945 Aug 05 19:56:35.751113 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 27/54] 10.222.0.39 () {64 vars in 1235 bytes} [Fri Aug 5 19:56:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:56:36.758271 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-e886b4ff-aab6-422f-8241-276cdd53d9fe admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:36.759284 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-e886b4ff-aab6-422f-8241-276cdd53d9fe admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 05 19:56:36.759691 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 28/55] 10.222.0.39 () {56 vars in 1074 bytes} [Fri Aug 5 19:56:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:37.289295 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-3926d999-e6d8-4fce-aee8-2e3bb4eedc08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:37.307425 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-3926d999-e6d8-4fce-aee8-2e3bb4eedc08 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.408284 Aug 05 19:56:37.307965 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 28/56] 10.222.0.39 () {64 vars in 1235 bytes} [Fri Aug 5 19:56:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:56:38.289105 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-e886b4ff-aab6-422f-8241-276cdd53d9fe admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:38.290261 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-e886b4ff-aab6-422f-8241-276cdd53d9fe admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Aug 05 19:56:38.290660 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 29/57] 10.222.0.39 () {56 vars in 1074 bytes} [Fri Aug 5 19:56:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:38.840801 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-3cd89947-78eb-416f-a541-a606019be87d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:38.859446 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-3cd89947-78eb-416f-a541-a606019be87d admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.427961 Aug 05 19:56:38.859985 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 29/58] 10.222.0.39 () {64 vars in 1235 bytes} [Fri Aug 5 19:56:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:56:39.839332 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-e886b4ff-aab6-422f-8241-276cdd53d9fe admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:39.840990 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-e886b4ff-aab6-422f-8241-276cdd53d9fe admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002042 Aug 05 19:56:39.841390 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 30/59] 10.222.0.39 () {56 vars in 1074 bytes} [Fri Aug 5 19:56:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:40.380034 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-f97cf815-b92e-4aed-9762-09c9f7c159d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 19:56:40.399256 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-f97cf815-b92e-4aed-9762-09c9f7c159d7 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.413587 Aug 05 19:56:40.399728 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 30/60] 10.222.0.39 () {64 vars in 1235 bytes} [Fri Aug 5 19:56:39 2022] POST /compute/v2.1/flavors => generated 409 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 19:56:41.377035 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-e886b4ff-aab6-422f-8241-276cdd53d9fe admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:41.378076 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-e886b4ff-aab6-422f-8241-276cdd53d9fe admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 05 19:56:41.378469 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 31/61] 10.222.0.39 () {56 vars in 1074 bytes} [Fri Aug 5 19:56:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:56:41.909927 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-ebbc3b0b-ac53-44d2-8dd7-07d8668bdfc2 admin admin] Calling method '>' {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:56:41.930395 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-ebbc3b0b-ac53-44d2-8dd7-07d8668bdfc2 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.414821 Aug 05 19:56:41.930931 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 31/62] 10.222.0.39 () {60 vars in 1202 bytes} [Fri Aug 5 19:56:41 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:57:34.200993 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-e886b4ff-aab6-422f-8241-276cdd53d9fe admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:34.202001 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-e886b4ff-aab6-422f-8241-276cdd53d9fe admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 05 19:57:34.202409 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 32/63] 10.222.0.39 () {54 vars in 931 bytes} [Fri Aug 5 19:57:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 19:57:34.213328 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG dbcounter [-] [103463] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:34.614302 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-a6771207-2549-459d-9a6d-a742ec94bc3a admin admin] Calling method '>' {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:34.637751 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-a6771207-2549-459d-9a6d-a742ec94bc3a admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.429223 Aug 05 19:57:34.638303 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 32/64] 10.222.0.39 () {60 vars in 1292 bytes} [Fri Aug 5 19:57:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 19:57:34.660886 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG dbcounter [-] [103462] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 19:57:34.665123 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-7e6c3510-778c-434b-8615-21656ba84a6e admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:34.674080 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-7e6c3510-778c-434b-8615-21656ba84a6e admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014854 Aug 05 19:57:34.674725 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 33/65] 10.222.0.39 () {60 vars in 1283 bytes} [Fri Aug 5 19:57:34 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:34.687424 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-faf39ad0-60d8-4dce-8fdb-b5bd1deef824 admin admin] Calling method '>' {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:34.696006 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-faf39ad0-60d8-4dce-8fdb-b5bd1deef824 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012230 Aug 05 19:57:34.696831 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 33/66] 10.222.0.39 () {60 vars in 1286 bytes} [Fri Aug 5 19:57:34 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:34.709360 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-171ba57a-2f76-4bd1-b3a5-76ebd88b0778 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:34.719018 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-171ba57a-2f76-4bd1-b3a5-76ebd88b0778 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013400 Aug 05 19:57:34.719568 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 34/67] 10.222.0.39 () {60 vars in 1286 bytes} [Fri Aug 5 19:57:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 19:57:34.731491 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-22142294-78f9-419f-ae47-36284c6ed393 admin admin] Calling method '>' {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 19:57:34.739898 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-22142294-78f9-419f-ae47-36284c6ed393 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012107 Aug 05 19:57:34.740509 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 34/68] 10.222.0.39 () {60 vars in 1283 bytes} [Fri Aug 5 19:57:34 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:00:35.124484 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-171ba57a-2f76-4bd1-b3a5-76ebd88b0778 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:35.125569 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-171ba57a-2f76-4bd1-b3a5-76ebd88b0778 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 05 20:00:35.125977 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 35/69] 10.222.0.39 () {56 vars in 1074 bytes} [Fri Aug 5 20:00:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:00:35.278927 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG dbcounter [-] [103463] Writing DB stats nova_api:SELECT=6 {{(pid=103463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:00:35.444127 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-6cb10410-e322-4f9d-8503-3d4132aee917 admin admin] Calling method '>' {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:35.446577 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:00:35.446577 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: warnings.warn(msg) Aug 05 20:00:35.447725 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-6cb10410-e322-4f9d-8503-3d4132aee917 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:35.448199 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-6cb10410-e322-4f9d-8503-3d4132aee917 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:35.448684 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-6cb10410-e322-4f9d-8503-3d4132aee917 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:35.449500 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-6cb10410-e322-4f9d-8503-3d4132aee917 admin admin] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:35.450024 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-6cb10410-e322-4f9d-8503-3d4132aee917 admin admin] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:35.450503 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-6cb10410-e322-4f9d-8503-3d4132aee917 admin admin] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:35.486096 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-6cb10410-e322-4f9d-8503-3d4132aee917 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.208655 Aug 05 20:00:35.486669 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 35/70] 10.222.0.39 () {60 vars in 1193 bytes} [Fri Aug 5 20:00:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:00:36.342280 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-171ba57a-2f76-4bd1-b3a5-76ebd88b0778 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:36.343274 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-171ba57a-2f76-4bd1-b3a5-76ebd88b0778 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Aug 05 20:00:36.343672 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 36/71] 10.222.0.39 () {56 vars in 1074 bytes} [Fri Aug 5 20:00:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:00:36.540826 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-7c3960dd-5b2d-4acb-b8dc-91d375e12da9 admin admin] Calling method '>' {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:36.543220 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:00:36.543220 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: warnings.warn(msg) Aug 05 20:00:36.544310 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-7c3960dd-5b2d-4acb-b8dc-91d375e12da9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:36.544828 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-7c3960dd-5b2d-4acb-b8dc-91d375e12da9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:36.545253 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-7c3960dd-5b2d-4acb-b8dc-91d375e12da9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:36.545959 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-7c3960dd-5b2d-4acb-b8dc-91d375e12da9 admin admin] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:36.546401 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-7c3960dd-5b2d-4acb-b8dc-91d375e12da9 admin admin] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:36.546812 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-7c3960dd-5b2d-4acb-b8dc-91d375e12da9 admin admin] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:36.566823 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-7c3960dd-5b2d-4acb-b8dc-91d375e12da9 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078473 Aug 05 20:00:36.567317 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 36/72] 10.222.0.39 () {60 vars in 1193 bytes} [Fri Aug 5 20:00:36 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:00:47.812892 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-171ba57a-2f76-4bd1-b3a5-76ebd88b0778 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:47.814475 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-171ba57a-2f76-4bd1-b3a5-76ebd88b0778 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002021 Aug 05 20:00:47.814890 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 37/73] 10.222.0.39 () {56 vars in 1074 bytes} [Fri Aug 5 20:00:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:00:47.957852 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG dbcounter [-] [103463] Writing DB stats nova_cell0:SELECT=4 {{(pid=103463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:00:47.958578 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG dbcounter [-] [103463] Writing DB stats nova_cell1:SELECT=4 {{(pid=103463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:00:47.959281 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG dbcounter [-] [103463] Writing DB stats nova_api:SELECT=8 {{(pid=103463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:00:48.008002 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-309dba66-6052-4002-b219-f128b9ed9142 admin admin] Calling method '>' {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:48.010431 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:00:48.010431 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: warnings.warn(msg) Aug 05 20:00:48.011542 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-309dba66-6052-4002-b219-f128b9ed9142 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:48.012019 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-309dba66-6052-4002-b219-f128b9ed9142 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:48.012452 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-309dba66-6052-4002-b219-f128b9ed9142 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:48.013192 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-309dba66-6052-4002-b219-f128b9ed9142 admin admin] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:48.013647 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-309dba66-6052-4002-b219-f128b9ed9142 admin admin] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:48.014063 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-309dba66-6052-4002-b219-f128b9ed9142 admin admin] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:48.039799 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-309dba66-6052-4002-b219-f128b9ed9142 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086342 Aug 05 20:00:48.040285 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 37/74] 10.222.0.39 () {60 vars in 1193 bytes} [Fri Aug 5 20:00:47 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:00:48.887175 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: DEBUG nova.api.openstack.wsgi [None req-171ba57a-2f76-4bd1-b3a5-76ebd88b0778 admin admin] Calling method '>' {{(pid=103462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:48.888344 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: INFO nova.api.openstack.requestlog [None req-171ba57a-2f76-4bd1-b3a5-76ebd88b0778 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 05 20:00:48.888695 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: [pid: 103462|app: 0|req: 38/75] 10.222.0.39 () {56 vars in 1074 bytes} [Fri Aug 5 20:00:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:00:49.080700 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG nova.api.openstack.wsgi [None req-27b42b14-4095-4860-a49f-92dcaebf0e32 admin admin] Calling method '>' {{(pid=103463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:00:49.083124 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:00:49.083124 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: warnings.warn(msg) Aug 05 20:00:49.084214 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-27b42b14-4095-4860-a49f-92dcaebf0e32 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:49.084725 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-27b42b14-4095-4860-a49f-92dcaebf0e32 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:49.085745 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-27b42b14-4095-4860-a49f-92dcaebf0e32 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:49.086688 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-27b42b14-4095-4860-a49f-92dcaebf0e32 admin admin] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:00:49.087135 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-27b42b14-4095-4860-a49f-92dcaebf0e32 admin admin] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:00:49.087558 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: DEBUG oslo_concurrency.lockutils [None req-27b42b14-4095-4860-a49f-92dcaebf0e32 admin admin] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:00:49.110315 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: INFO nova.api.openstack.requestlog [None req-27b42b14-4095-4860-a49f-92dcaebf0e32 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.081427 Aug 05 20:00:49.110806 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: [pid: 103463|app: 0|req: 38/76] 10.222.0.39 () {60 vars in 1193 bytes} [Fri Aug 5 20:00:49 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:01:51.383324 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: Fri Aug 5 20:01:51 2022 - graceful shutdown triggered... Aug 05 20:01:51.383828 dv-cinder-852210-2-iscsi devstack@n-api.service[103462]: Gracefully killing worker 1 (pid: 103462)... Aug 05 20:01:51.383445 dv-cinder-852210-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 05 20:01:51.384635 dv-cinder-852210-2-iscsi devstack@n-api.service[103463]: Gracefully killing worker 2 (pid: 103463)... Aug 05 20:01:52.384461 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: worker 1 buried after 1 seconds Aug 05 20:01:52.384461 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: worker 2 buried after 1 seconds Aug 05 20:01:52.385109 dv-cinder-852210-2-iscsi devstack@n-api.service[103461]: goodbye to uWSGI. Aug 05 20:01:52.386080 dv-cinder-852210-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 05 20:01:52.386635 dv-cinder-852210-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 05 20:01:52.389444 dv-cinder-852210-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 05 20:01:52.400014 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 05 20:01:52.401980 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 5 20:01:52 2022] *** Aug 05 20:01:52.401980 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 05 20:01:52.401980 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 05 20:01:52.401980 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: nodename: dv-cinder-852210-2-iscsi Aug 05 20:01:52.401980 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: machine: x86_64 Aug 05 20:01:52.401980 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: clock source: unix Aug 05 20:01:52.401980 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: pcre jit disabled Aug 05 20:01:52.401980 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: detected number of CPU cores: 4 Aug 05 20:01:52.401980 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: current working directory: / Aug 05 20:01:52.401980 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: detected binary path: /usr/bin/uwsgi-core Aug 05 20:01:52.401980 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: your processes number limit is 47680 Aug 05 20:01:52.402673 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: your memory page size is 4096 bytes Aug 05 20:01:52.402673 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: detected max file descriptor number: 2048 Aug 05 20:01:52.402673 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: lock engine: pthread robust mutexes Aug 05 20:01:52.402673 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: thunder lock: enabled Aug 05 20:01:52.402673 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 05 20:01:52.402673 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 05 20:01:52.443705 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: Python main interpreter initialized at 0x5587977bd9c0 Aug 05 20:01:52.443705 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: python threads support enabled Aug 05 20:01:52.443705 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: your server socket listen backlog is limited to 100 connections Aug 05 20:01:52.443705 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: your mercy for graceful operations on workers is 90 seconds Aug 05 20:01:52.444165 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: mapped 403077 bytes (393 KB) for 2 cores Aug 05 20:01:52.444165 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: *** Operational MODE: preforking *** Aug 05 20:01:52.444433 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: *** uWSGI is running in multiple interpreter mode *** Aug 05 20:01:52.444433 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: spawned uWSGI master process (pid: 118172) Aug 05 20:01:52.444665 dv-cinder-852210-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 05 20:01:52.445296 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: spawned uWSGI worker 1 (pid: 118191, cores: 1) Aug 05 20:01:52.448261 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: spawned uWSGI worker 2 (pid: 118192, cores: 1) Aug 05 20:01:52.452895 dv-cinder-852210-2-iscsi devstack@n-api.service[118172]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 05 20:01:53.111045 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 20:01:53.128826 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 20:01:54.273570 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 20:01:54.273570 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: from cryptography.utils import int_from_bytes Aug 05 20:01:54.274291 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 20:01:54.274291 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: from cryptography.utils import int_from_bytes Aug 05 20:01:54.300724 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 20:01:54.300724 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: from cryptography.utils import int_from_bytes Aug 05 20:01:54.301230 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 20:01:54.301230 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: from cryptography.utils import int_from_bytes Aug 05 20:01:56.627442 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 20:01:56.627985 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 20:01:56.628331 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 20:01:56.628616 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 20:01:56.628916 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 20:01:56.629300 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.629667 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.629937 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.630302 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.630610 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.630902 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.631223 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.631548 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.632662 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.632864 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.633397 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.633714 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-2-iscsi {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.634063 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.634359 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.634677 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.635000 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.635313 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.635699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.636004 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.636467 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.638231 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.638231 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.638231 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.638231 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.638231 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.638626 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.638822 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.639138 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.639472 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.639760 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.640203 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-2-iscsi {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.640531 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.640881 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.641272 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.641604 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.641924 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.642243 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.642568 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.642883 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.643198 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.643540 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.643866 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.644187 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.644516 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.644850 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.645165 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.645480 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.645805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.646115 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.646427 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.646686 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.647263 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.647633 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.648184 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.648498 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.648747 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.649001 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.649326 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.649653 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.649965 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.650283 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.650595 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.650907 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.651220 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.651533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.651846 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.652157 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.652476 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.652819 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.653150 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.653463 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.653785 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.654192 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.654447 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.654759 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.655102 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.655422 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.655735 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.656060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.656383 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.656764 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.657024 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.657336 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.657659 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.657998 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.658307 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.658560 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.658866 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.659175 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.659495 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.659805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.660114 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.660423 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.660749 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.661060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.661368 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.661679 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.661989 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.662327 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.662603 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.662913 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.663257 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.663568 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.663896 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.664221 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.664529 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.664869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.665177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.665486 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.666280 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 20:01:56.666940 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.667044 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 20:01:56.667129 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.667129 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.667281 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 20:01:56.667368 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.667439 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 20:01:56.667633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 20:01:56.667845 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.668029 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.668428 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.668598 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.668982 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.669091 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.669281 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.669612 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.669719 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.669933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.670031 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.670264 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.670511 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.670603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.670916 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.671013 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.671185 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.671286 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.671509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.671608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.671843 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-2-iscsi {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.671933 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.672169 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.672258 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.672487 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.672637 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.672825 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.672984 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.673140 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.673292 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.673442 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.673598 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.673747 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.673916 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.677693 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.677882 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.678035 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.678212 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.678376 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.678519 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.678660 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.679450 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.679711 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.679898 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.680052 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.680052 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.680329 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.680472 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.680675 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.680675 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.680954 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.681094 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.681245 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.681411 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.681624 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.681780 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.681903 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.682077 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.682206 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.682349 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-2-iscsi {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.682495 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.682632 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.682769 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.682919 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.683067 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.683067 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.684518 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.684740 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.684936 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.685671 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.685831 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.686102 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.686264 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.686418 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.686560 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.686833 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.686979 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.687120 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.687262 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.687418 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.687560 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.687701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.687841 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.687982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.688139 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.688292 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.688292 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.688855 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.689000 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.689140 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.689280 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.689431 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.689759 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.689913 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.690034 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.690152 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.690272 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.690395 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.690395 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.690620 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.690786 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.690904 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.691189 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.691341 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.691482 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.691622 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.691779 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.691928 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.691928 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.692300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.692300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.692866 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.693019 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.693177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.693327 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.693471 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.693619 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.693774 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.694064 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.694226 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.695245 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.695546 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.695695 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.695836 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.695985 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.696244 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.696394 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.696534 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.696701 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.696844 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.697003 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.697145 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.697294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.697447 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.697599 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.697749 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.697903 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.698044 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.698183 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.698322 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.705811 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.706153 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.706452 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.706614 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.706614 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.706906 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.707080 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.707234 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.707388 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.707536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.707687 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.707828 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.707980 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.708131 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.708281 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.708421 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.708421 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.708421 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.708869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.709035 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.709186 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.709186 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.709461 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.709461 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.709736 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.709736 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.710053 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.710197 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.710345 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.710486 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.710647 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.710647 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.710976 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.711125 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.711267 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.711421 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.712715 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.712818 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.712901 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.713000 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.713085 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.713157 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.713244 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.713317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.713395 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.713466 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.713535 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.713603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.713680 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.713760 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.713845 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.713925 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.714015 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.714098 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.714170 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.714248 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.714319 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.714395 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.714465 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.714541 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.714624 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.714709 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.714709 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.714870 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.714949 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.715027 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.715098 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.715180 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.715262 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.715341 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.715420 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.715490 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.715571 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.715642 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.715718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.715795 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.715880 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.715958 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.716029 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.716098 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.716174 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.716254 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.716332 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.716403 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.716472 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.716541 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.716541 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.716716 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.716796 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.716867 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.716936 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.717013 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.717083 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.717164 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.717236 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.717305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.717373 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.717441 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.717510 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.717590 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.717662 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.717761 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.717833 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.717914 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.717999 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.718077 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.718147 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.718215 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.718291 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.718369 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.718451 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.718528 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.718608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.718704 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.718804 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.718886 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.718965 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.719044 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.719115 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.719183 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.719251 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.719326 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.719419 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.719499 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.721101 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.721200 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.721275 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.721361 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.721442 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.721513 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.721589 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.721665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:01:56.721738 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.721895 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.721992 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.722065 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.722143 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.722227 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.722304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.722382 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.722461 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.722540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.722614 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.722682 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.722760 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.722838 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.722910 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.722986 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.723056 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.723125 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.723217 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.723297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.723368 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.723436 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.723505 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.723580 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.723719 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.723815 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.723894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.723972 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.724042 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.724118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.724200 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.724279 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.724350 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.724419 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.724488 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.724570 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.724682 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.724755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.724825 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.724958 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.725029 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.725119 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.725209 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.725300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.725390 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.725481 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.726139 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.726243 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.726337 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.726337 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.726506 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.726598 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.726682 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.726777 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.726856 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.726938 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.727015 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.727093 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.727171 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.727254 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.727326 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.727395 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.727463 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.727539 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.727618 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.727697 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.727822 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.727908 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.727989 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.728061 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.728138 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.728209 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.728278 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.728355 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.728436 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.728507 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.728636 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.728869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.728966 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.729048 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.729119 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.729195 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.729274 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.729352 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.729430 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.729501 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.729577 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.729670 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.729798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.729871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.729941 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.730018 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.730088 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.730170 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.730252 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.730339 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.730637 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.730724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.730803 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.730884 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.730963 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.731034 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.731286 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.731442 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.731542 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.731637 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.731722 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.731892 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.731983 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.732055 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.732135 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.732215 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.732286 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.732361 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.732431 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.732499 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.732590 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.732666 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.732811 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.732935 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.733134 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.733246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.733457 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.733593 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.733779 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.733910 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.734095 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.734220 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.734418 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.734541 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.734738 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.734877 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.735052 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.735194 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.735391 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.735521 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.735712 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.735839 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.736026 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.736158 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.736359 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.736486 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.736697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.736834 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.737012 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.737152 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.737338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.737650 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.737757 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.737844 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.737967 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.738068 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.738289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.738387 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.738612 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.738711 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.738944 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.739049 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.739266 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.739365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.739589 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.739695 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.740014 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.740118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.740205 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.740288 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.740769 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.740895 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.740895 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.741323 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.741848 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.742002 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.742195 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.742288 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.742371 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.742507 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.742597 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.742678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.742750 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.742833 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.742960 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.743195 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.743345 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.743456 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.743670 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.743830 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.743985 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.744102 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.744694 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.744816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.744901 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.744974 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.745050 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.745128 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.745263 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.745363 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.745575 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.745657 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.745896 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.745984 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.746211 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.746301 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.747872 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.747977 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.748099 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.748173 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.748173 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.748313 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.748397 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.748474 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.748553 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.748767 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.749332 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.749485 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.749626 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.749767 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.749956 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.750155 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.750355 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.750520 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.750679 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.751069 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.751221 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.751409 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.751676 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.751923 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.752126 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.752348 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.752512 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.752705 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.752856 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.753005 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.753169 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.753327 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.753519 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.753682 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.753839 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.753987 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.754168 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.754330 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.754479 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.754635 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.754791 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.754939 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.755104 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.755252 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.755414 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.755604 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.755757 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.755905 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.756052 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.756255 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.756424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.756644 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.757347 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.757347 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.757690 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.757854 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.758017 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.758247 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.758465 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.758638 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.758801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.758959 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.759118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.759362 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.759600 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.759800 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.759962 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.760171 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.760384 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.760539 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.760721 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.760721 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.761260 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.761421 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.761571 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.761816 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.761816 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.762232 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.762390 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.762548 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.762707 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.762866 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.763022 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.763178 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.763340 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.763497 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.763645 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.763830 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.763991 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.764141 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.764299 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.764495 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.764678 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.764851 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.764851 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.765145 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.765302 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.765452 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.765607 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.765763 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.765920 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.766069 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.766229 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.766378 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.766532 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.766680 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.766847 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.767009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.767165 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.767320 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.767468 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.767621 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.767777 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.768006 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.768349 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.768556 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.768743 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.768902 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.769058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.769232 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.769382 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.769538 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.769695 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.769844 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.770002 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.770175 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.770367 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.770518 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.770674 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.770822 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.770977 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.770977 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.771541 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.771699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.772276 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.772622 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.772846 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.773010 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.773188 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.773411 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.773666 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.773906 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.774167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.774426 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.774653 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.774829 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.774980 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.775136 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.775300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.775450 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.775598 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.775746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.775894 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.776048 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.776211 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.776433 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.776641 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.776819 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.776969 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.777132 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.777280 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.777428 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.777584 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.777740 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.777887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.778043 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.778192 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.778345 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.778494 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.778641 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.778798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.778959 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.779108 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.779255 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.779411 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.779560 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.779714 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.781536 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.781708 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.781861 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.782025 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.782204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.782529 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.782701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.782851 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.783007 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.783165 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.783314 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.783483 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.783635 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.783795 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.783944 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.784092 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.784239 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.784239 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.784623 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.784794 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.784944 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.785091 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.785248 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.785410 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.785665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.785833 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.785983 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.786139 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.786302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.786452 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.786609 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.786778 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.786929 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.787077 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.787077 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.787370 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.787533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.787692 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.787920 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.788635 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.788825 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.788982 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.789131 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.789523 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.789767 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.789953 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.790108 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.790279 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.790574 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.790811 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.790968 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.791117 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.791317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.791845 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.792010 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.792174 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.792325 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.792797 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.792971 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.793132 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.793132 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.793427 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.793584 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.793733 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.793889 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.794037 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.794201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.794360 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.794509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.794674 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.794839 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.794989 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.795146 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.795295 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.795444 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.795591 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.795745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.795902 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.796064 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.796222 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.796378 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.796528 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.796721 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.796905 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.797072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.797224 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.797224 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.797516 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.797516 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.797821 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.797978 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.798134 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.798291 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.798291 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.798572 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.798743 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.798743 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.799034 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.799182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.799330 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.799485 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.799641 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.799799 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.799948 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.800104 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.800261 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.800421 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.800652 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.800858 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.800858 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.801167 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.801325 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.801484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.801659 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.802026 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.802182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.802331 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.802482 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.802729 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.803507 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.804061 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.804240 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.804402 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.804560 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.804921 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.805175 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.805408 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.805642 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.806127 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.806309 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.806472 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.806623 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.806781 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.806944 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.807094 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.807262 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.807419 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.807569 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.807718 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.807867 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.808014 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.808170 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.808319 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.808474 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.808678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.808837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.808996 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.809153 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.809153 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.809445 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.809600 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.809757 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.809906 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.810064 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.810222 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.810370 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.810525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.810733 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.810898 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.811058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.811207 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.811355 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.811502 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.811658 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.811821 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.812256 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.812420 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.812570 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.812906 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.813065 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.813229 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.813386 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.813673 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.813837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.813988 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.814146 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.814316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.814474 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.814623 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.814771 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.814927 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.815088 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.815238 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.815386 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.815546 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.815702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.815858 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.816015 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.816015 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.816308 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.816457 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.816457 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.816786 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.816986 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.817141 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.817291 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.817291 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.817595 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.817746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.817908 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.817908 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.818207 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.818363 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.818520 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.818679 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.818828 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.818977 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.819124 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.819280 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.820027 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.820204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.820364 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.820522 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.820803 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.821070 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.821304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.821516 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.821670 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.821826 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.821975 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.822372 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.822372 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.822766 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.823026 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.823182 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.823342 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.823501 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.823682 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.823935 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.824099 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.824249 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.824404 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.824555 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.824770 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.824933 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.825098 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.825247 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.825403 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.825554 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.825712 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.825861 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.825861 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.826164 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.826328 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.826479 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.826628 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.826783 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.826939 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.827105 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.827264 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.827414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.827568 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.827725 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.827873 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.828020 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.828181 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.828330 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.828487 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.828667 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.828824 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.828971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.829144 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.829294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.829443 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.829598 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.829755 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.829918 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.832857 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.833173 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.833354 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.833510 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.833671 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.833834 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.834106 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.834106 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.834428 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.834578 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.834727 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.834890 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.834890 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.835814 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.835974 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.836126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.836290 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.836495 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.836672 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.836847 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.836997 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.837182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.837345 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.837505 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.837701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.837854 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.838003 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.838153 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.838316 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.838475 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.838633 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.838782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.838941 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.839098 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.839262 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.839411 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.839560 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.839708 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.839864 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.840013 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.840173 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.840331 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.840489 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.840489 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.840873 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.841060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.841213 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.841370 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.841520 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.841676 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.841825 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.841982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.842139 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.842289 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.842438 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.842636 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.843033 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.843307 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.843474 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.843624 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.843785 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.843943 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.844120 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.844374 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.844531 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.844786 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.844955 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.845106 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.845263 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.845424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.845575 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.845722 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.845878 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.846041 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.846191 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.846338 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.846486 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.846635 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.846791 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.846948 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.846948 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.847250 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.847399 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.847546 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.847694 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.847855 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.848013 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.848162 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.848310 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.848464 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.848691 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.848938 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.849129 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.849282 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.849450 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.849450 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.849750 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.849909 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.850065 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.850213 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.850361 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.850508 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.850721 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.850873 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.851033 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.851182 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.851182 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.851474 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.851632 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.851783 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.851933 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.852081 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.852229 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.852396 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.852794 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.853221 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.853463 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.853629 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.853788 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.853964 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.854115 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.854271 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.854521 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.854678 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.854834 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.854834 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.855143 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.855299 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.855455 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.855611 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.855766 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.855923 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.856085 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.856243 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.856400 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.856558 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.856755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.856755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.857089 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.857246 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.857395 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.857549 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.857709 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.857865 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.858014 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.858202 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.858488 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.858643 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.858806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.858955 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.859114 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.859264 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.859419 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.859568 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.859679 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.859679 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.859887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.859979 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.860064 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.860158 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.860243 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.860335 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.860426 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.860511 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.860673 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.860805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.860925 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.861040 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.861150 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.861259 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.861375 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.861499 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.861618 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.861736 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.861853 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.861963 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.862072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.862195 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.862313 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.862424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.862532 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.862640 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.862640 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.862908 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.862908 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.863355 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.863490 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.863685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.863685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.863909 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.864020 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.864142 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.864252 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.864371 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.864491 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.864790 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.864917 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.865028 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.865176 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.865301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.865421 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.865533 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.865650 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.865761 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.865872 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.865990 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.866101 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.866303 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.866425 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.866537 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.866647 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.866767 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.866879 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.866990 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.867106 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.867216 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.867325 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.867449 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.867570 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.867681 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.867798 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.867908 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.868023 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.868147 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.868265 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.868375 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.868483 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.868646 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.868646 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.868893 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.868893 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.869099 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.869208 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.869355 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.869476 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.869595 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.869714 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.869714 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.869714 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.869714 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.870125 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.870242 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.870352 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.870460 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.870569 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.870678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.870799 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.870924 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.871049 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.871168 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.871284 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.871404 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.871529 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.871640 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.871751 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.871867 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.871977 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.872094 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.872094 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.872299 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.872416 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.872526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.872655 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.872831 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.872985 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.873110 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.873442 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.873573 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.873701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.873701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.874011 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.874124 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.874242 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.874354 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.874547 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.874669 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.874889 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.875008 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.875008 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.875222 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.875345 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.875345 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.875592 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.875703 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.875820 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.875931 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.876052 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.876163 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.876271 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.876380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.876490 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.876680 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.876805 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.876926 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.877043 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.877161 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.877278 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.877398 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.877509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.877626 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.877743 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.877854 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.877970 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.878092 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.878209 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.878319 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.878427 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.878536 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.878659 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.878769 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.878769 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.878980 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.879107 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.879223 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.879360 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.879471 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.879588 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.879698 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.879698 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.879922 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.880038 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.880150 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.880150 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.880365 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.880481 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.880616 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.880732 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.880857 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.880934 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.881004 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.881085 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.881169 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.881242 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.881318 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.881397 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.881474 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.881554 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.881625 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.881696 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.881765 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.882416 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.882416 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.882575 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.883297 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.883870 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.884077 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.884195 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.884323 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.884445 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.884566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.884754 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.884884 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.884884 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.885202 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.885329 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.885450 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.885569 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.885688 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.885812 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.885937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.886049 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.886049 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.886371 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.886491 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.886609 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.886733 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.886851 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.886969 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.887079 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.887196 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.887311 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.887431 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.887549 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.887659 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.887775 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.887885 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.887885 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.888098 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.888209 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.888209 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.888423 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.888542 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.888696 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.888810 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.888920 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.889028 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.889143 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.889254 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.889254 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.889469 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.889586 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.889696 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.889803 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.889803 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.890018 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.890130 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.890238 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.890346 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.890454 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.890563 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.890680 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.890798 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.890907 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.891021 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.891138 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.891256 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.891373 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.891489 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.891606 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.891722 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.891831 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.891960 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.892082 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.892203 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.892313 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.892422 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.892537 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.892701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.892815 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.892941 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.893059 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.893220 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.893392 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.893505 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.893624 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.893955 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.894091 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.894274 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.894399 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.894511 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.894629 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.894747 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.894864 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.894974 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.895097 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.895215 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.895433 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.895559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.895669 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.895787 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.895913 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.896038 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.896154 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.896264 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.896380 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.896503 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.896678 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.897067 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.897189 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.897343 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.897551 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.898218 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.898400 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.898600 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.898752 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.898868 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.898868 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.899221 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.899335 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.899446 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.899446 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.899667 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.899667 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.899886 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.900004 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 20:01:56.900115 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.900115 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.900115 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.900115 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.900538 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.900726 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.900949 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.901276 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.901602 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.901965 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.902294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.902893 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.903235 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.903571 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.904152 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.904322 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.904549 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.904893 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.905211 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.905548 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.905871 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.906383 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.906713 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.907036 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.907361 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.907683 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.908008 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.908330 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.908689 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.909145 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.909474 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.909797 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.910118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.910439 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.910769 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.911132 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.911467 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.911797 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.912125 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.912453 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.912829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.913232 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.913648 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.914451 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.914451 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.914939 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.915092 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.915329 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.915778 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.916108 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.916674 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.917014 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.917338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.917675 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.918009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.918332 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.918664 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.919020 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.919804 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.919804 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.920109 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.920343 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.920693 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.921012 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.921591 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.921928 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.922277 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.922600 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.922917 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.923362 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.923591 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.923849 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.924166 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.924502 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.924808 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.925128 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.925441 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.925755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.926076 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.926373 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.926870 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.927190 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.927511 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.927825 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.928141 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.928455 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.928828 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.929259 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.929509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.929816 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.930142 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.930475 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.930800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.931130 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.931460 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.931797 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.932096 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.932429 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.932853 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.933202 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.933525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.933843 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.934171 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.935554 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.936047 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.936439 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.936678 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.937005 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.937327 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.937671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.938009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.938352 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.938686 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.939014 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.939359 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.939686 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.940012 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.940338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.940689 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.941016 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.941346 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.941669 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.941991 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.942322 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.942653 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.942999 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.943339 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.943663 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.944001 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.944910 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.945315 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.945643 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.946012 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.946355 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.946683 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.947006 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.947324 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:01:56.947579 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 20:01:57.051962 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO dbcounter [None req-d730067c-87c5-4b20-9721-0df9eb0054cc None None] Registered counter for database nova_api Aug 05 20:01:57.074705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_db.sqlalchemy.engines [None req-d730067c-87c5-4b20-9721-0df9eb0054cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118191) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:01:57.081645 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writer thread running {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:01:57.098799 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO dbcounter [None req-b813405c-1269-4b10-b13d-de6f1412f9db None None] Registered counter for database nova_api Aug 05 20:01:57.120787 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_db.sqlalchemy.engines [None req-b813405c-1269-4b10-b13d-de6f1412f9db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118192) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:01:57.127541 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writer thread running {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:01:57.142156 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.context [None req-d730067c-87c5-4b20-9721-0df9eb0054cc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0ecc5c16-c10c-4818-88aa-214f9c959337(cell1) {{(pid=118191) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 20:01:57.143407 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d730067c-87c5-4b20-9721-0df9eb0054cc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:01:57.143891 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d730067c-87c5-4b20-9721-0df9eb0054cc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:01:57.145533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d730067c-87c5-4b20-9721-0df9eb0054cc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:01:57.146262 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d730067c-87c5-4b20-9721-0df9eb0054cc None None] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:01:57.146714 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d730067c-87c5-4b20-9721-0df9eb0054cc None None] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:01:57.149608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d730067c-87c5-4b20-9721-0df9eb0054cc None None] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:01:57.151648 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO dbcounter [None req-d730067c-87c5-4b20-9721-0df9eb0054cc None None] Registered counter for database nova_cell0 Aug 05 20:01:57.155815 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO dbcounter [None req-d730067c-87c5-4b20-9721-0df9eb0054cc None None] Registered counter for database nova_cell1 Aug 05 20:01:57.163179 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_db.sqlalchemy.engines [None req-d730067c-87c5-4b20-9721-0df9eb0054cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118191) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:01:57.165905 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_db.sqlalchemy.engines [None req-d730067c-87c5-4b20-9721-0df9eb0054cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118191) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:01:57.171004 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writer thread running {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:01:57.176195 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writer thread running {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:01:57.186360 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.context [None req-b813405c-1269-4b10-b13d-de6f1412f9db None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0ecc5c16-c10c-4818-88aa-214f9c959337(cell1) {{(pid=118192) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 20:01:57.190469 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b813405c-1269-4b10-b13d-de6f1412f9db None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:01:57.190954 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b813405c-1269-4b10-b13d-de6f1412f9db None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:01:57.192566 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b813405c-1269-4b10-b13d-de6f1412f9db None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:01:57.193319 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b813405c-1269-4b10-b13d-de6f1412f9db None None] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:01:57.193774 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b813405c-1269-4b10-b13d-de6f1412f9db None None] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:01:57.195866 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b813405c-1269-4b10-b13d-de6f1412f9db None None] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:01:57.197915 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO dbcounter [None req-b813405c-1269-4b10-b13d-de6f1412f9db None None] Registered counter for database nova_cell0 Aug 05 20:01:57.201986 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO dbcounter [None req-b813405c-1269-4b10-b13d-de6f1412f9db None None] Registered counter for database nova_cell1 Aug 05 20:01:57.209783 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_db.sqlalchemy.engines [None req-b813405c-1269-4b10-b13d-de6f1412f9db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118192) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:01:57.212784 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_db.sqlalchemy.engines [None req-b813405c-1269-4b10-b13d-de6f1412f9db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118192) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:01:57.219832 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writer thread running {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:01:57.223596 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writer thread running {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:01:57.322326 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO dbcounter [None req-d730067c-87c5-4b20-9721-0df9eb0054cc None None] Registered counter for database nova_cell0 Aug 05 20:01:57.329530 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_db.sqlalchemy.engines [None req-d730067c-87c5-4b20-9721-0df9eb0054cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118191) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:01:57.334060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writer thread running {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:01:57.374289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO dbcounter [None req-b813405c-1269-4b10-b13d-de6f1412f9db None None] Registered counter for database nova_cell0 Aug 05 20:01:57.381021 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_db.sqlalchemy.engines [None req-b813405c-1269-4b10-b13d-de6f1412f9db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118192) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:01:57.385735 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writer thread running {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:01:57.657920 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: WARNING keystonemiddleware.auth_token [None req-d730067c-87c5-4b20-9721-0df9eb0054cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 20:01:57.665524 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: WARNING keystonemiddleware.auth_token [None req-d730067c-87c5-4b20-9721-0df9eb0054cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 20:01:57.718496 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: WARNING keystonemiddleware.auth_token [None req-b813405c-1269-4b10-b13d-de6f1412f9db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 20:01:57.726013 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: WARNING keystonemiddleware.auth_token [None req-b813405c-1269-4b10-b13d-de6f1412f9db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 20:01:58.013272 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: WARNING keystonemiddleware.auth_token [None req-d730067c-87c5-4b20-9721-0df9eb0054cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 20:01:58.019252 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: WARNING keystonemiddleware.auth_token [None req-d730067c-87c5-4b20-9721-0df9eb0054cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 20:01:58.026577 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5587977bd9c0 pid: 118191 (default app) Aug 05 20:01:58.073756 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: WARNING keystonemiddleware.auth_token [None req-b813405c-1269-4b10-b13d-de6f1412f9db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 20:01:58.079788 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: WARNING keystonemiddleware.auth_token [None req-b813405c-1269-4b10-b13d-de6f1412f9db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 20:01:58.086175 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5587977bd9c0 pid: 118192 (default app) Aug 05 20:02:32.339967 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=3 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:02:32.342351 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=3 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:02:32.343309 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=3 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:02:32.344326 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=3 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:02:33.227979 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f8d80c44-6049-4c92-b249-b1ae19e9d749 tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] Action: 'create', calling method: .version_select at 0x7fe3e655bdc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1005878374", "metadata": {"Type": "work"}}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:02:33.234871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f8d80c44-6049-4c92-b249-b1ae19e9d749 tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] Request method failure captured: Aug 05 20:02:33.234871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 20:02:33.234871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:02:33.234871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:02:33.234871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:02:33.234871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 122 Aug 05 20:02:33.234871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:02:33.234871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:02:33.234871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:02:33.234871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:02:33.234871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XdYjKuo4OtOe0cH3x1SZyv-mpS7TnGlTdDsrSjtWJxcAP2XprpExLSqhG6Q3fLm2IVijDuxytZsUSCrzIfirwba8RL0xq7hHAQc1Qatjik8u5ONiDn0Ev5q_bD3NJGa-_-BXdQ0YRy_GY7tr8vocVAq3kv4dJk0XR8ykVSFyEr4IGk Aug 05 20:02:33.234871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:02:33.234871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:02:33.234871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:02:33.234871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:02:33.234871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:02:33.234871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:02:33.234871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: 14fabce3f6c44a1a915271ac06967e6c Aug 05 20:02:33.234871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-VolumesNegativeTest-940724306 Aug 05 20:02:33.234871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:02:33.234871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:02:33.236307 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/14fabce3f6c44a1a915271ac06967e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/14fabce3f6c44a1a915271ac06967e6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/14fabce3f6c44a1a915271ac06967e6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_14fabce3f6c44a1a915271ac06967e6c", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:02:33.236307 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-VolumesNegativeTest-940724306 Aug 05 20:02:33.236307 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: 14fabce3f6c44a1a915271ac06967e6c Aug 05 20:02:33.236307 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-VolumesNegativeTest-940724306 Aug 05 20:02:33.236307 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-VolumesNegativeTest-940724306-project Aug 05 20:02:33.236307 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:02:33.236307 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:02:33.236307 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: 36190049a17141deac9faff37e681794 Aug 05 20:02:33.236307 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-VolumesNegativeTest-940724306-project Aug 05 20:02:33.236307 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Aug 05 20:02:33.236307 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1005878374", "metadata": {"Type": "work"}}} Aug 05 20:02:33.236307 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: Aug 05 20:02:33.236307 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 20:02:33.242482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1005878374', 'metadata': {'Type': 'work'}}}} Aug 05 20:02:33.242482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:02:33.242482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:02:33.242482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 20:02:33.242482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 20:02:33.242482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 20:02:33.242482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise error Aug 05 20:02:33.242482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 05 20:02:33.242482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:02:33.242482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 05 20:02:33.242482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 20:02:33.242482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:02:33.242482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 20:02:33.242482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi '#$%' Aug 05 20:02:33.242482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:02:33.242482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:02:33.242482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:02:33.242482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:02:33.242482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:02:33.242482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:02:33.242482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:02:33.242482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:02:33.244550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:02:33.244550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:02:33.244550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:02:33.244550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:02:33.244550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 20:02:33.244550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 20:02:33.244550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 20:02:33.244550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 20:02:33.244550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 20:02:33.244550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 20:02:33.244550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 20:02:33.244550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:02:33.244550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:02:33.244550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:02:33.244550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:02:33.244550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:02:33.244550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:02:33.244550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 20:02:33.244550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 20:02:33.246094 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 20:02:33.246094 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:02:33.246094 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f8d80c44-6049-4c92-b249-b1ae19e9d749 tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:02:33.246094 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f8d80c44-6049-4c92-b249-b1ae19e9d749 tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.906063 Aug 05 20:02:33.246094 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 1/1] 10.222.0.39 () {60 vars in 1156 bytes} [Fri Aug 5 20:02:32 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 908 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 05 20:02:33.249547 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=3 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:02:33.250447 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=3 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:02:33.251074 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell0:SELECT=3 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:02:33.251783 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell0:SELECT=3 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:02:33.475410 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-f8383f07-4ebb-4258-9a10-c0d57dace91d tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] Action: 'create', calling method: .version_select at 0x7fe3e65c98b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1593812233", "metadata": {"Type": "work"}}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:02:33.479782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-f8383f07-4ebb-4258-9a10-c0d57dace91d tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] Request method failure captured: Aug 05 20:02:33.479782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 20:02:33.479782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:02:33.479782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:02:33.479782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:02:33.479782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 120 Aug 05 20:02:33.479782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:02:33.479782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:02:33.479782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:02:33.479782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:02:33.479782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XdYjKuo4OtOe0cH3x1SZyv-mpS7TnGlTdDsrSjtWJxcAP2XprpExLSqhG6Q3fLm2IVijDuxytZsUSCrzIfirwba8RL0xq7hHAQc1Qatjik8u5ONiDn0Ev5q_bD3NJGa-_-BXdQ0YRy_GY7tr8vocVAq3kv4dJk0XR8ykVSFyEr4IGk Aug 05 20:02:33.479782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:02:33.479782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:02:33.479782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:02:33.479782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:02:33.479782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:02:33.479782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:02:33.479782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: 14fabce3f6c44a1a915271ac06967e6c Aug 05 20:02:33.479782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-VolumesNegativeTest-940724306 Aug 05 20:02:33.479782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:02:33.479782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:02:33.481659 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/14fabce3f6c44a1a915271ac06967e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/14fabce3f6c44a1a915271ac06967e6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/14fabce3f6c44a1a915271ac06967e6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_14fabce3f6c44a1a915271ac06967e6c", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:02:33.481659 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-VolumesNegativeTest-940724306 Aug 05 20:02:33.481659 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: 14fabce3f6c44a1a915271ac06967e6c Aug 05 20:02:33.481659 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-VolumesNegativeTest-940724306 Aug 05 20:02:33.481659 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-VolumesNegativeTest-940724306-project Aug 05 20:02:33.481659 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:02:33.481659 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:02:33.481659 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: 36190049a17141deac9faff37e681794 Aug 05 20:02:33.481659 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-VolumesNegativeTest-940724306-project Aug 05 20:02:33.481659 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Aug 05 20:02:33.481659 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1593812233", "metadata": {"Type": "work"}}} Aug 05 20:02:33.481659 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: Aug 05 20:02:33.481659 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 20:02:33.482887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1593812233', 'metadata': {'Type': 'work'}}}} Aug 05 20:02:33.482887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:02:33.482887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:02:33.482887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 20:02:33.482887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 20:02:33.482887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 20:02:33.482887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise error Aug 05 20:02:33.482887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 05 20:02:33.482887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:02:33.482887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 05 20:02:33.482887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 20:02:33.482887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:02:33.482887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 20:02:33.482887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi '0' Aug 05 20:02:33.482887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:02:33.482887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:02:33.482887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:02:33.482887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:02:33.482887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:02:33.482887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:02:33.482887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:02:33.482887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:02:33.484302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:02:33.484302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:02:33.484302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:02:33.484302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:02:33.484302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 20:02:33.484302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 20:02:33.484302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 20:02:33.484302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 20:02:33.484302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 20:02:33.484302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 20:02:33.484302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 20:02:33.484302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:02:33.484302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:02:33.484302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:02:33.484302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:02:33.484302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:02:33.484302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:02:33.484302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 20:02:33.484302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 20:02:33.485426 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 20:02:33.485426 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:02:33.485426 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-f8383f07-4ebb-4258-9a10-c0d57dace91d tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:02:33.485426 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-f8383f07-4ebb-4258-9a10-c0d57dace91d tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.237293 Aug 05 20:02:33.485426 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 1/2] 10.222.0.39 () {60 vars in 1156 bytes} [Fri Aug 5 20:02:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 239 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 20:02:33.491971 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7f650027-ff46-4f39-904a-214516a2862e tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] Action: 'create', calling method: .version_select at 0x7fe3e64658b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1579717078", "metadata": {"Type": "work"}}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:02:33.495559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7f650027-ff46-4f39-904a-214516a2862e tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] Request method failure captured: Aug 05 20:02:33.495559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 20:02:33.495559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:02:33.495559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:02:33.495559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:02:33.495559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 119 Aug 05 20:02:33.495559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:02:33.495559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:02:33.495559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:02:33.495559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:02:33.495559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XdYjKuo4OtOe0cH3x1SZyv-mpS7TnGlTdDsrSjtWJxcAP2XprpExLSqhG6Q3fLm2IVijDuxytZsUSCrzIfirwba8RL0xq7hHAQc1Qatjik8u5ONiDn0Ev5q_bD3NJGa-_-BXdQ0YRy_GY7tr8vocVAq3kv4dJk0XR8ykVSFyEr4IGk Aug 05 20:02:33.495559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:02:33.495559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:02:33.495559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:02:33.495559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:02:33.495559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:02:33.495559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:02:33.495559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: 14fabce3f6c44a1a915271ac06967e6c Aug 05 20:02:33.495559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-VolumesNegativeTest-940724306 Aug 05 20:02:33.495559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:02:33.495559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:02:33.496922 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/14fabce3f6c44a1a915271ac06967e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/14fabce3f6c44a1a915271ac06967e6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/14fabce3f6c44a1a915271ac06967e6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_14fabce3f6c44a1a915271ac06967e6c", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:02:33.496922 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-VolumesNegativeTest-940724306 Aug 05 20:02:33.496922 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: 14fabce3f6c44a1a915271ac06967e6c Aug 05 20:02:33.496922 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-VolumesNegativeTest-940724306 Aug 05 20:02:33.496922 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-VolumesNegativeTest-940724306-project Aug 05 20:02:33.496922 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:02:33.496922 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:02:33.496922 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: 36190049a17141deac9faff37e681794 Aug 05 20:02:33.496922 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-VolumesNegativeTest-940724306-project Aug 05 20:02:33.496922 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Aug 05 20:02:33.496922 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1579717078", "metadata": {"Type": "work"}}} Aug 05 20:02:33.496922 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: Aug 05 20:02:33.496922 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 20:02:33.502099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1579717078', 'metadata': {'Type': 'work'}}}} Aug 05 20:02:33.502099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:02:33.502099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:02:33.502099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 20:02:33.502099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 20:02:33.502099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 20:02:33.502099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise error Aug 05 20:02:33.502099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 05 20:02:33.502099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:02:33.502099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 05 20:02:33.502099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 20:02:33.502099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:02:33.502099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 20:02:33.502099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi '' Aug 05 20:02:33.502099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:02:33.502099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:02:33.502099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:02:33.502099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:02:33.502099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:02:33.502099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:02:33.502099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:02:33.502099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:02:33.504140 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:02:33.504140 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:02:33.504140 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:02:33.504140 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:02:33.504140 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 20:02:33.504140 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 20:02:33.504140 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 20:02:33.504140 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 20:02:33.504140 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 20:02:33.504140 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 20:02:33.504140 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 20:02:33.504140 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:02:33.504140 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:02:33.504140 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:02:33.504140 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:02:33.504140 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:02:33.504140 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:02:33.504140 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 20:02:33.504140 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 20:02:33.507980 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 20:02:33.507980 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:02:33.507980 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7f650027-ff46-4f39-904a-214516a2862e tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:02:33.507980 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-7f650027-ff46-4f39-904a-214516a2862e tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009059 Aug 05 20:02:33.507980 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 2/3] 10.222.0.39 () {60 vars in 1156 bytes} [Fri Aug 5 20:02:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 20:02:33.509348 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a2dbd22c-0050-4633-a291-10c976aab162 tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] Calling method '.version_select at 0x7fe3e65c9f70>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:35.316326 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-a2dbd22c-0050-4633-a291-10c976aab162 tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] HTTP exception thrown: Volume tempest-invalid-1301283026 could not be found. Aug 05 20:02:35.323671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a2dbd22c-0050-4633-a291-10c976aab162 tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] Request method failure captured: Aug 05 20:02:35.323671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1301283026 HTTP/1.1 Aug 05 20:02:35.323671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:02:35.323671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:02:35.323671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:02:35.323671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 0 Aug 05 20:02:35.323671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:02:35.323671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:02:35.323671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:02:35.323671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:02:35.323671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XdYjKuo4OtOe0cH3x1SZyv-mpS7TnGlTdDsrSjtWJxcAP2XprpExLSqhG6Q3fLm2IVijDuxytZsUSCrzIfirwba8RL0xq7hHAQc1Qatjik8u5ONiDn0Ev5q_bD3NJGa-_-BXdQ0YRy_GY7tr8vocVAq3kv4dJk0XR8ykVSFyEr4IGk Aug 05 20:02:35.323671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:02:35.323671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:02:35.323671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:02:35.323671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:02:35.323671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:02:35.323671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:02:35.323671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: 14fabce3f6c44a1a915271ac06967e6c Aug 05 20:02:35.323671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-VolumesNegativeTest-940724306 Aug 05 20:02:35.323671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:02:35.323671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:02:35.325272 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/14fabce3f6c44a1a915271ac06967e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/14fabce3f6c44a1a915271ac06967e6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/14fabce3f6c44a1a915271ac06967e6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_14fabce3f6c44a1a915271ac06967e6c", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:02:35.325272 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-VolumesNegativeTest-940724306 Aug 05 20:02:35.325272 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: 14fabce3f6c44a1a915271ac06967e6c Aug 05 20:02:35.325272 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-VolumesNegativeTest-940724306 Aug 05 20:02:35.325272 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-VolumesNegativeTest-940724306-project Aug 05 20:02:35.325272 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:02:35.325272 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:02:35.325272 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: 36190049a17141deac9faff37e681794 Aug 05 20:02:35.325272 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-VolumesNegativeTest-940724306-project Aug 05 20:02:35.325272 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: Aug 05 20:02:35.325272 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Volume tempest-invalid-1301283026 could not be found. Aug 05 20:02:35.325272 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'id': 'tempest-invalid-1301283026'} Aug 05 20:02:35.325272 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:02:35.326317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:02:35.326317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:02:35.326317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:02:35.326317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 20:02:35.326317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 20:02:35.326317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 20:02:35.326317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 20:02:35.326317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 20:02:35.326317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 20:02:35.326317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 20:02:35.326317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 20:02:35.326317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:02:35.326317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:02:35.326317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:02:35.326317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:02:35.326317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1301283026 could not be found. (HTTP 404) (Request-ID: req-89f4b170-dca7-40db-8401-0c4ad69dcf49) Aug 05 20:02:35.326317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:02:35.326317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:02:35.326317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:02:35.327732 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:02:35.327732 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 20:02:35.327732 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 20:02:35.327732 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 20:02:35.327732 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 20:02:35.327732 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 20:02:35.327732 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 20:02:35.327732 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 20:02:35.327732 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 20:02:35.327732 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:02:35.327732 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:02:35.327732 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 20:02:35.327732 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 20:02:35.327732 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 20:02:35.327732 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 20:02:35.327732 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 20:02:35.327732 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 20:02:35.327732 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 20:02:35.327732 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 20:02:35.329100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:02:35.329100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:02:35.329100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:02:35.329100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:02:35.329100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1301283026 could not be found. Aug 05 20:02:35.329100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:02:35.329100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:02:35.329100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:02:35.329100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:02:35.329100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:02:35.329100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:02:35.329100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:02:35.329100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:02:35.329100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:02:35.329100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:02:35.329100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:02:35.329100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:02:35.329100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 20:02:35.329100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:02:35.329100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1301283026 could not be found. Aug 05 20:02:35.330556 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:02:35.330556 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:02:35.330556 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:02:35.330556 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:02:35.330556 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:02:35.330556 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:02:35.330556 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:02:35.330556 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:02:35.330556 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1301283026 could not be found. Aug 05 20:02:35.330556 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:02:35.335072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a2dbd22c-0050-4633-a291-10c976aab162 tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] Returning 404 to user: Volume tempest-invalid-1301283026 could not be found. {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:02:35.337901 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a2dbd22c-0050-4633-a291-10c976aab162 tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1301283026" status: 404 len: 99 microversion: 2.1 time: 1.833627 Aug 05 20:02:35.340947 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1218 bytes} [Fri Aug 5 20:02:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1301283026 => generated 99 bytes in 1839 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 05 20:02:35.349058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-2479b8dc-54ec-4a49-af3a-c44ee2a98972 tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003862 Aug 05 20:02:35.349954 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 3/5] 10.222.0.39 () {58 vars in 1140 bytes} [Fri Aug 5 20:02:35 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 05 20:02:35.360014 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-44759163-8630-4c8a-a8d9-869b3aaa2a1a tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004530 Aug 05 20:02:35.372645 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 3/6] 10.222.0.39 () {58 vars in 1137 bytes} [Fri Aug 5 20:02:35 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 05 20:02:35.382327 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-348a698f-3c58-4abe-8e9f-f9ca24e78dfa tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] Calling method '.version_select at 0x7fe3e6425b80>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:36.707204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-348a698f-3c58-4abe-8e9f-f9ca24e78dfa tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] HTTP exception thrown: Volume 3faeff43-a0b6-4552-bdca-440da1b0cc81 could not be found. Aug 05 20:02:36.707204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-348a698f-3c58-4abe-8e9f-f9ca24e78dfa tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] Request method failure captured: Aug 05 20:02:36.707204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: DELETE /compute/v2.1/os-volumes/3faeff43-a0b6-4552-bdca-440da1b0cc81 HTTP/1.1 Aug 05 20:02:36.707204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:02:36.707204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:02:36.707204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:02:36.707204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:02:36.707204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:02:36.707204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:02:36.707204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:02:36.707204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:02:36.707204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XdYjKuo4OtOe0cH3x1SZyv-mpS7TnGlTdDsrSjtWJxcAP2XprpExLSqhG6Q3fLm2IVijDuxytZsUSCrzIfirwba8RL0xq7hHAQc1Qatjik8u5ONiDn0Ev5q_bD3NJGa-_-BXdQ0YRy_GY7tr8vocVAq3kv4dJk0XR8ykVSFyEr4IGk Aug 05 20:02:36.707204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:02:36.707204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:02:36.707204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:02:36.707204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:02:36.707204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:02:36.707204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:02:36.707204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: 14fabce3f6c44a1a915271ac06967e6c Aug 05 20:02:36.707204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-VolumesNegativeTest-940724306 Aug 05 20:02:36.707204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:02:36.707204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:02:36.710346 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/14fabce3f6c44a1a915271ac06967e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/14fabce3f6c44a1a915271ac06967e6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/14fabce3f6c44a1a915271ac06967e6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_14fabce3f6c44a1a915271ac06967e6c", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:02:36.710346 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-VolumesNegativeTest-940724306 Aug 05 20:02:36.710346 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: 14fabce3f6c44a1a915271ac06967e6c Aug 05 20:02:36.710346 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-VolumesNegativeTest-940724306 Aug 05 20:02:36.710346 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-VolumesNegativeTest-940724306-project Aug 05 20:02:36.710346 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:02:36.710346 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:02:36.710346 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: 36190049a17141deac9faff37e681794 Aug 05 20:02:36.710346 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-VolumesNegativeTest-940724306-project Aug 05 20:02:36.710346 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: Aug 05 20:02:36.710346 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Volume 3faeff43-a0b6-4552-bdca-440da1b0cc81 could not be found. Aug 05 20:02:36.710346 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'id': '3faeff43-a0b6-4552-bdca-440da1b0cc81'} Aug 05 20:02:36.710346 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:02:36.712484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:02:36.712484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:02:36.712484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:02:36.712484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 20:02:36.712484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 20:02:36.712484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 20:02:36.712484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 20:02:36.712484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 20:02:36.712484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 20:02:36.712484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 20:02:36.712484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 20:02:36.712484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:02:36.712484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:02:36.712484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:02:36.712484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:02:36.712484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3faeff43-a0b6-4552-bdca-440da1b0cc81 could not be found. (HTTP 404) (Request-ID: req-d63994fe-839b-4e4e-9a9d-9deaf23828ad) Aug 05 20:02:36.712484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:02:36.712484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:02:36.712484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:02:36.714001 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:02:36.714001 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 20:02:36.714001 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 20:02:36.714001 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 20:02:36.714001 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 20:02:36.714001 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 20:02:36.714001 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 20:02:36.714001 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 20:02:36.714001 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 20:02:36.714001 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:02:36.714001 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:02:36.714001 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 20:02:36.714001 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 20:02:36.714001 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 20:02:36.714001 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 20:02:36.714001 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 20:02:36.714001 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 20:02:36.714001 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 20:02:36.714001 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 20:02:36.715494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:02:36.715494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:02:36.715494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:02:36.715494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:02:36.715494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3faeff43-a0b6-4552-bdca-440da1b0cc81 could not be found. Aug 05 20:02:36.715494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:02:36.715494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:02:36.715494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:02:36.715494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:02:36.715494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:02:36.715494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:02:36.715494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:02:36.715494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:02:36.715494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:02:36.715494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:02:36.715494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:02:36.715494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:02:36.715494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 20:02:36.715494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:02:36.716871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3faeff43-a0b6-4552-bdca-440da1b0cc81 could not be found. Aug 05 20:02:36.716871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:02:36.716871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:02:36.716871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:02:36.716871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:02:36.716871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:02:36.716871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:02:36.716871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:02:36.716871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:02:36.716871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3faeff43-a0b6-4552-bdca-440da1b0cc81 could not be found. Aug 05 20:02:36.716871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:02:36.716871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-348a698f-3c58-4abe-8e9f-f9ca24e78dfa tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] Returning 404 to user: Volume 3faeff43-a0b6-4552-bdca-440da1b0cc81 could not be found. {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:02:36.716871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-348a698f-3c58-4abe-8e9f-f9ca24e78dfa tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/3faeff43-a0b6-4552-bdca-440da1b0cc81" status: 404 len: 109 microversion: 2.1 time: 1.268001 Aug 05 20:02:36.716871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1248 bytes} [Fri Aug 5 20:02:35 2022] DELETE /compute/v2.1/os-volumes/3faeff43-a0b6-4552-bdca-440da1b0cc81 => generated 109 bytes in 1272 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:02:36.719300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4e546043-8887-4901-bc7d-fe4ce73c1849 tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] Calling method '.version_select at 0x7fe3e6da6c10>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:36.966007 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-4e546043-8887-4901-bc7d-fe4ce73c1849 tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] HTTP exception thrown: Volume 9cd6929e-486e-4e45-bc9c-422d0ecc2260 could not be found. Aug 05 20:02:36.968524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4e546043-8887-4901-bc7d-fe4ce73c1849 tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] Request method failure captured: Aug 05 20:02:36.968524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: GET /compute/v2.1/os-volumes/9cd6929e-486e-4e45-bc9c-422d0ecc2260 HTTP/1.1 Aug 05 20:02:36.968524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:02:36.968524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:02:36.968524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:02:36.968524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 0 Aug 05 20:02:36.968524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:02:36.968524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:02:36.968524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:02:36.968524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:02:36.968524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XdYjKuo4OtOe0cH3x1SZyv-mpS7TnGlTdDsrSjtWJxcAP2XprpExLSqhG6Q3fLm2IVijDuxytZsUSCrzIfirwba8RL0xq7hHAQc1Qatjik8u5ONiDn0Ev5q_bD3NJGa-_-BXdQ0YRy_GY7tr8vocVAq3kv4dJk0XR8ykVSFyEr4IGk Aug 05 20:02:36.968524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:02:36.968524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:02:36.968524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:02:36.968524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:02:36.968524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:02:36.968524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:02:36.968524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: 14fabce3f6c44a1a915271ac06967e6c Aug 05 20:02:36.968524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-VolumesNegativeTest-940724306 Aug 05 20:02:36.968524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:02:36.968524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:02:36.970178 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/14fabce3f6c44a1a915271ac06967e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/14fabce3f6c44a1a915271ac06967e6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/14fabce3f6c44a1a915271ac06967e6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_14fabce3f6c44a1a915271ac06967e6c", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:02:36.970178 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-VolumesNegativeTest-940724306 Aug 05 20:02:36.970178 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: 14fabce3f6c44a1a915271ac06967e6c Aug 05 20:02:36.970178 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-VolumesNegativeTest-940724306 Aug 05 20:02:36.970178 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-VolumesNegativeTest-940724306-project Aug 05 20:02:36.970178 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:02:36.970178 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:02:36.970178 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: 36190049a17141deac9faff37e681794 Aug 05 20:02:36.970178 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-VolumesNegativeTest-940724306-project Aug 05 20:02:36.970178 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: Aug 05 20:02:36.970178 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Volume 9cd6929e-486e-4e45-bc9c-422d0ecc2260 could not be found. Aug 05 20:02:36.970178 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'id': '9cd6929e-486e-4e45-bc9c-422d0ecc2260'} Aug 05 20:02:36.970178 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:02:36.971388 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:02:36.971388 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:02:36.971388 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:02:36.971388 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 20:02:36.971388 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 20:02:36.971388 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 20:02:36.971388 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 20:02:36.971388 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:02:36.971388 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:02:36.971388 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:02:36.971388 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:02:36.971388 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:02:36.971388 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:02:36.971388 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:02:36.971388 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:02:36.971388 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9cd6929e-486e-4e45-bc9c-422d0ecc2260 could not be found. (HTTP 404) (Request-ID: req-2092f7c8-4b21-4e50-86df-0b7e9272a164) Aug 05 20:02:36.971388 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:02:36.971388 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:02:36.971388 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:02:36.973154 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:02:36.973154 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 20:02:36.973154 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 20:02:36.973154 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 20:02:36.973154 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 20:02:36.973154 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 20:02:36.973154 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 20:02:36.973154 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 20:02:36.973154 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 20:02:36.973154 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:02:36.973154 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:02:36.973154 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 20:02:36.973154 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 20:02:36.973154 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 20:02:36.973154 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 20:02:36.973154 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:02:36.973154 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:02:36.973154 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:02:36.973154 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:02:36.974829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:02:36.974829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:02:36.974829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:02:36.974829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:02:36.974829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9cd6929e-486e-4e45-bc9c-422d0ecc2260 could not be found. Aug 05 20:02:36.974829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:02:36.974829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:02:36.974829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:02:36.974829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:02:36.974829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:02:36.974829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:02:36.974829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:02:36.974829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:02:36.974829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:02:36.974829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:02:36.974829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:02:36.974829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:02:36.974829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 20:02:36.974829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:02:36.976275 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9cd6929e-486e-4e45-bc9c-422d0ecc2260 could not be found. Aug 05 20:02:36.976275 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:02:36.976275 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:02:36.976275 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:02:36.976275 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:02:36.976275 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:02:36.976275 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:02:36.976275 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:02:36.976275 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:02:36.976275 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9cd6929e-486e-4e45-bc9c-422d0ecc2260 could not be found. Aug 05 20:02:36.976275 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:02:36.978157 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4e546043-8887-4901-bc7d-fe4ce73c1849 tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] Returning 404 to user: Volume 9cd6929e-486e-4e45-bc9c-422d0ecc2260 could not be found. {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:02:36.979173 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-4e546043-8887-4901-bc7d-fe4ce73c1849 tempest-VolumesNegativeTest-940724306 tempest-VolumesNegativeTest-940724306-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/9cd6929e-486e-4e45-bc9c-422d0ecc2260" status: 404 len: 109 microversion: 2.1 time: 0.321084 Aug 05 20:02:36.979889 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Aug 5 20:02:36 2022] GET /compute/v2.1/os-volumes/9cd6929e-486e-4e45-bc9c-422d0ecc2260 => generated 109 bytes in 323 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:02:38.377210 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e4752cf5-135a-41df-a482-c7e9f461881d tempest-VolumesTestJSON-5954203 tempest-VolumesTestJSON-5954203-project] Calling method '.version_select at 0x7fe3e6369790>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:38.512481 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e4752cf5-135a-41df-a482-c7e9f461881d tempest-VolumesTestJSON-5954203 tempest-VolumesTestJSON-5954203-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/b2e914d7-85ef-46c1-8f8c-95176c2fb463" status: 200 len: 351 microversion: 2.1 time: 0.148441 Aug 05 20:02:38.513343 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 5/9] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Aug 5 20:02:38 2022] GET /compute/v2.1/os-volumes/b2e914d7-85ef-46c1-8f8c-95176c2fb463 => generated 351 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:02:40.105714 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-193cdae0-8808-4cbc-9476-c18f56703542 tempest-VolumesTestJSON-5954203 tempest-VolumesTestJSON-5954203-project] Calling method '.version_select at 0x7fe3e635eee0>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:40.274522 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-193cdae0-8808-4cbc-9476-c18f56703542 tempest-VolumesTestJSON-5954203 tempest-VolumesTestJSON-5954203-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/d9f55105-944c-4e5b-b824-824ab286fca3" status: 200 len: 350 microversion: 2.1 time: 0.172791 Aug 05 20:02:40.275147 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 5/10] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Aug 5 20:02:40 2022] GET /compute/v2.1/os-volumes/d9f55105-944c-4e5b-b824-824ab286fca3 => generated 350 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:02:42.240074 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-59a11545-e9c0-4cd7-b7d4-2b2e30d526e5 tempest-VolumesTestJSON-5954203 tempest-VolumesTestJSON-5954203-project] Calling method '.version_select at 0x7fe3e6369ee0>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:42.334743 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-59a11545-e9c0-4cd7-b7d4-2b2e30d526e5 tempest-VolumesTestJSON-5954203 tempest-VolumesTestJSON-5954203-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/6c37f7cd-f78e-4cdf-8688-7119fa1ecb9f" status: 200 len: 350 microversion: 2.1 time: 0.098916 Aug 05 20:02:42.335821 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 6/11] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Aug 5 20:02:42 2022] GET /compute/v2.1/os-volumes/6c37f7cd-f78e-4cdf-8688-7119fa1ecb9f => generated 350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:02:42.350691 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-e69a975c-e032-42b9-8f39-48413152c128 tempest-VolumesTestJSON-5954203 tempest-VolumesTestJSON-5954203-project] Calling method '.version_select at 0x7fe3e6368550>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:42.640973 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-e69a975c-e032-42b9-8f39-48413152c128 tempest-VolumesTestJSON-5954203 tempest-VolumesTestJSON-5954203-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.295818 Aug 05 20:02:42.641500 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1134 bytes} [Fri Aug 5 20:02:42 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:02:42.660228 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-57c3ba8f-ad5a-49e3-960d-dca925c6f54a tempest-VolumesTestJSON-5954203 tempest-VolumesTestJSON-5954203-project] Calling method '.version_select at 0x7fe3e6369d30>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:42.895964 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-57c3ba8f-ad5a-49e3-960d-dca925c6f54a tempest-VolumesTestJSON-5954203 tempest-VolumesTestJSON-5954203-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.240322 Aug 05 20:02:42.899253 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 7/13] 10.222.0.39 () {58 vars in 1149 bytes} [Fri Aug 5 20:02:42 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:02:42.918045 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-45dd8c42-4c82-437f-9ddc-90a1c482916e tempest-VolumesTestJSON-5954203 tempest-VolumesTestJSON-5954203-project] Calling method '.version_select at 0x7fe3e6d5d040>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:43.115133 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-45dd8c42-4c82-437f-9ddc-90a1c482916e tempest-VolumesTestJSON-5954203 tempest-VolumesTestJSON-5954203-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.203096 Aug 05 20:02:43.115710 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 7/14] 10.222.0.39 () {58 vars in 1134 bytes} [Fri Aug 5 20:02:42 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:02:43.128634 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-bc4be084-86c8-45f3-8773-d40de2264da0 tempest-VolumesTestJSON-5954203 tempest-VolumesTestJSON-5954203-project] Calling method '.version_select at 0x7fe3e637c940>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:43.244249 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-bc4be084-86c8-45f3-8773-d40de2264da0 tempest-VolumesTestJSON-5954203 tempest-VolumesTestJSON-5954203-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.119544 Aug 05 20:02:43.244916 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 8/15] 10.222.0.39 () {58 vars in 1167 bytes} [Fri Aug 5 20:02:43 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:02:43.263602 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-cdac567d-eaec-47e7-b147-6b45af84a0f4 tempest-VolumesTestJSON-5954203 tempest-VolumesTestJSON-5954203-project] Calling method '.version_select at 0x7fe3e6373310>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:43.387497 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-cdac567d-eaec-47e7-b147-6b45af84a0f4 tempest-VolumesTestJSON-5954203 tempest-VolumesTestJSON-5954203-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.128268 Aug 05 20:02:43.389200 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 8/16] 10.222.0.39 () {58 vars in 1170 bytes} [Fri Aug 5 20:02:43 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:02:43.408563 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-1ebc6d24-d560-44df-b018-163436c4d947 tempest-VolumesTestJSON-5954203 tempest-VolumesTestJSON-5954203-project] Calling method '.version_select at 0x7fe3e637c8b0>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:43.615532 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-1ebc6d24-d560-44df-b018-163436c4d947 tempest-VolumesTestJSON-5954203 tempest-VolumesTestJSON-5954203-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.212182 Aug 05 20:02:43.629129 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 9/17] 10.222.0.39 () {58 vars in 1155 bytes} [Fri Aug 5 20:02:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:02:43.633728 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-0b8db0ab-4361-4288-96be-d655b641b41d tempest-VolumesTestJSON-5954203 tempest-VolumesTestJSON-5954203-project] Calling method '.version_select at 0x7fe3e63725e0>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:43.845409 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-0b8db0ab-4361-4288-96be-d655b641b41d tempest-VolumesTestJSON-5954203 tempest-VolumesTestJSON-5954203-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.218345 Aug 05 20:02:43.846279 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 9/18] 10.222.0.39 () {58 vars in 1188 bytes} [Fri Aug 5 20:02:43 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:02:43.863114 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-b6c71b28-a9bc-4ecc-a1d3-6525613d09d9 tempest-VolumesTestJSON-5954203 tempest-VolumesTestJSON-5954203-project] Calling method '.version_select at 0x7fe3e6369940>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:44.073644 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-b6c71b28-a9bc-4ecc-a1d3-6525613d09d9 tempest-VolumesTestJSON-5954203 tempest-VolumesTestJSON-5954203-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.215671 Aug 05 20:02:44.074569 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 10/19] 10.222.0.39 () {58 vars in 1155 bytes} [Fri Aug 5 20:02:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:02:48.493410 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-9dfaaac3-c4f4-4850-ac0e-b77291f6b95a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Action: 'create', calling method: .version_select at 0x7fe3e6368e50>, body: {"keypair": {"name": "tempest-keypair-504048960", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUYTaXaarU5149FRnZ/R2hAT3SyRKnpJebG6VIuhUnZTWSQ/bJDhSLXiWHGwcsh5w+lHbZxnKza5VcS/D7Gx1NS9TXAksqU7ZTcMPBMn5KeQa+mQujvJOaigXgbU5oC8A=="}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:02:48.628234 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-202e348b-6af1-42c1-8916-abd47f1d0540 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1395984339", "imageRef": "c148255e-9574-4d10-b9bb-13c9411eda77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:02:48.641777 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-9dfaaac3-c4f4-4850-ac0e-b77291f6b95a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Getting quotas for project 5b265913f9bd46b9b36c18d567d0cf66. Resources: {'key_pairs'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:02:48.658818 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-9dfaaac3-c4f4-4850-ac0e-b77291f6b95a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Getting quotas for user 1afe13c8fbb1468b8ef3d0d0c671208d and project 5b265913f9bd46b9b36c18d567d0cf66. Resources: {'key_pairs'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:02:48.810514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-9dfaaac3-c4f4-4850-ac0e-b77291f6b95a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.098678 Aug 05 20:02:48.821105 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 10/20] 10.222.0.39 () {60 vars in 1159 bytes} [Fri Aug 5 20:02:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:02:48.977733 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.network.neutron [None req-202e348b-6af1-42c1-8916-abd47f1d0540 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] validate_networks() for [('32e23f54-487d-4a73-8ea1-6e99e83c698e', None, None, None, None, None)] {{(pid=118191) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:02:50.920501 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-566cac9f-696f-4d80-94c9-ff4a0524a50a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1826911875", "imageRef": "c148255e-9574-4d10-b9bb-13c9411eda77", "flavorRef": "452", "networks": [{"uuid": "7092b181-fcbe-48d0-ae8e-157aa913db96"}]}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:02:51.169792 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.network.neutron [None req-566cac9f-696f-4d80-94c9-ff4a0524a50a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] validate_networks() for [('7092b181-fcbe-48d0-ae8e-157aa913db96', None, None, None, None, None)] {{(pid=118192) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:02:51.663041 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-202e348b-6af1-42c1-8916-abd47f1d0540 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Flavor limits 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:02:51.663605 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-202e348b-6af1-42c1-8916-abd47f1d0540 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Image limits 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:02:51.663945 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-202e348b-6af1-42c1-8916-abd47f1d0540 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Flavor pref 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:02:51.664347 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-202e348b-6af1-42c1-8916-abd47f1d0540 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Image pref 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:02:51.664940 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-202e348b-6af1-42c1-8916-abd47f1d0540 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:02:51.701533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-202e348b-6af1-42c1-8916-abd47f1d0540 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:51.702029 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-202e348b-6af1-42c1-8916-abd47f1d0540 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:51.702468 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-202e348b-6af1-42c1-8916-abd47f1d0540 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:51.703719 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-202e348b-6af1-42c1-8916-abd47f1d0540 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:51.703719 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-202e348b-6af1-42c1-8916-abd47f1d0540 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:51.704050 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-202e348b-6af1-42c1-8916-abd47f1d0540 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:51.818877 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-202e348b-6af1-42c1-8916-abd47f1d0540 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Getting quotas for project c5b5718607784ec9be3289f7916f70a6. Resources: {'cores', 'ram', 'instances'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:02:51.843430 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-202e348b-6af1-42c1-8916-abd47f1d0540 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Getting quotas for user 293b8a62f19c45c1bf5b897c7cf40edb and project c5b5718607784ec9be3289f7916f70a6. Resources: {'cores', 'ram', 'instances'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:02:51.860061 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-202e348b-6af1-42c1-8916-abd47f1d0540 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Going to run 1 instances... {{(pid=118191) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:02:51.864856 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-202e348b-6af1-42c1-8916-abd47f1d0540 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c148255e-9574-4d10-b9bb-13c9411eda77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118191) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:02:52.076071 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-202e348b-6af1-42c1-8916-abd47f1d0540 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.210711 Aug 05 20:02:52.079191 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 11/21] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Aug 5 20:02:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 4218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:02:52.125907 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9fe56dd5-4ef9-4f37-818d-dc9e7f3b6fa4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:52.128530 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-9fe56dd5-4ef9-4f37-818d-dc9e7f3b6fa4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:52.281118 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9fe56dd5-4ef9-4f37-818d-dc9e7f3b6fa4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:52.314672 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-9fe56dd5-4ef9-4f37-818d-dc9e7f3b6fa4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1222 microversion: 2.1 time: 0.226879 Aug 05 20:02:52.315260 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 12/22] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:52 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1222 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:02:52.590385 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-566cac9f-696f-4d80-94c9-ff4a0524a50a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Flavor limits 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:02:52.590912 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-566cac9f-696f-4d80-94c9-ff4a0524a50a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Image limits 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:02:52.591766 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-566cac9f-696f-4d80-94c9-ff4a0524a50a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Flavor pref 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:02:52.592156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-566cac9f-696f-4d80-94c9-ff4a0524a50a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Image pref 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:02:52.592662 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-566cac9f-696f-4d80-94c9-ff4a0524a50a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:02:52.649037 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-566cac9f-696f-4d80-94c9-ff4a0524a50a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:52.651507 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-566cac9f-696f-4d80-94c9-ff4a0524a50a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:52.655942 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-566cac9f-696f-4d80-94c9-ff4a0524a50a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:52.663923 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-566cac9f-696f-4d80-94c9-ff4a0524a50a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:52.666020 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-566cac9f-696f-4d80-94c9-ff4a0524a50a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:52.668021 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-566cac9f-696f-4d80-94c9-ff4a0524a50a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:52.690270 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-cc06e452-0949-4f21-9533-aeb9e6fd50d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1943253609", "imageRef": "c148255e-9574-4d10-b9bb-13c9411eda77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:02:52.775848 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-566cac9f-696f-4d80-94c9-ff4a0524a50a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Getting quotas for project 2bb000ac20014d618784b262288bac32. Resources: {'cores', 'ram', 'instances'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:02:52.787745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-566cac9f-696f-4d80-94c9-ff4a0524a50a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Getting quotas for user 83e975aed96648fc9c06f95d49c6f6f9 and project 2bb000ac20014d618784b262288bac32. Resources: {'cores', 'ram', 'instances'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:02:52.810886 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.network.neutron [None req-cc06e452-0949-4f21-9533-aeb9e6fd50d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] validate_networks() for [('32e23f54-487d-4a73-8ea1-6e99e83c698e', None, None, None, None, None)] {{(pid=118191) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:02:52.885542 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-566cac9f-696f-4d80-94c9-ff4a0524a50a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Going to run 1 instances... {{(pid=118192) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:02:52.898682 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-566cac9f-696f-4d80-94c9-ff4a0524a50a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c148255e-9574-4d10-b9bb-13c9411eda77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:02:53.166939 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-566cac9f-696f-4d80-94c9-ff4a0524a50a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.637072 Aug 05 20:02:53.167621 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 11/23] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Aug 5 20:02:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:02:53.204566 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-18a53f87-428a-40e9-a8c3-76fe17564565 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:53.207929 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-18a53f87-428a-40e9-a8c3-76fe17564565 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:53.778061 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-18a53f87-428a-40e9-a8c3-76fe17564565 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:53.845083 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-18a53f87-428a-40e9-a8c3-76fe17564565 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1215 microversion: 2.1 time: 0.668534 Aug 05 20:02:53.849808 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 12/24] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:53 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1215 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:02:54.881747 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-0b72aa4a-5787-4d34-93a5-807ab4c2f01c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:54.883415 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-0b72aa4a-5787-4d34-93a5-807ab4c2f01c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:55.712631 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-0b72aa4a-5787-4d34-93a5-807ab4c2f01c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:55.763862 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-0b72aa4a-5787-4d34-93a5-807ab4c2f01c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1215 microversion: 2.1 time: 0.884124 Aug 05 20:02:55.766990 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 13/25] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:54 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1215 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:02:55.967046 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-6f541dc1-cda1-4664-9a58-10363183a4ee tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1762234743", "imageRef": "c148255e-9574-4d10-b9bb-13c9411eda77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d7536c13-8fba-4a9d-87ec-6a7bf401477c"}], "security_groups": [{"name": "tempest-securitygroup--1065968780"}], "key_name": "tempest-keypair-504048960", "user_data": "}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:02:56.603061 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-cc06e452-0949-4f21-9533-aeb9e6fd50d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Flavor limits 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:02:56.603773 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-cc06e452-0949-4f21-9533-aeb9e6fd50d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Image limits 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:02:56.605097 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-cc06e452-0949-4f21-9533-aeb9e6fd50d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Flavor pref 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:02:56.605578 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-cc06e452-0949-4f21-9533-aeb9e6fd50d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Image pref 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:02:56.606143 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-cc06e452-0949-4f21-9533-aeb9e6fd50d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:02:56.634788 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cc06e452-0949-4f21-9533-aeb9e6fd50d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:56.635355 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cc06e452-0949-4f21-9533-aeb9e6fd50d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:56.637863 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cc06e452-0949-4f21-9533-aeb9e6fd50d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:56.639546 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cc06e452-0949-4f21-9533-aeb9e6fd50d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:56.641360 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cc06e452-0949-4f21-9533-aeb9e6fd50d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:56.642611 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cc06e452-0949-4f21-9533-aeb9e6fd50d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:56.698759 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-cc06e452-0949-4f21-9533-aeb9e6fd50d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Getting quotas for project c5b5718607784ec9be3289f7916f70a6. Resources: {'cores', 'ram', 'instances'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:02:56.704799 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-cc06e452-0949-4f21-9533-aeb9e6fd50d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Getting quotas for user 293b8a62f19c45c1bf5b897c7cf40edb and project c5b5718607784ec9be3289f7916f70a6. Resources: {'cores', 'ram', 'instances'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:02:56.745917 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.network.neutron [None req-6f541dc1-cda1-4664-9a58-10363183a4ee tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] validate_networks() for [('d7536c13-8fba-4a9d-87ec-6a7bf401477c', None, None, None, None, None)] {{(pid=118192) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:02:56.754693 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-cc06e452-0949-4f21-9533-aeb9e6fd50d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Going to run 1 instances... {{(pid=118191) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:02:56.772432 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-cc06e452-0949-4f21-9533-aeb9e6fd50d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c148255e-9574-4d10-b9bb-13c9411eda77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118191) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:02:56.850480 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-cc06e452-0949-4f21-9533-aeb9e6fd50d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.167194 Aug 05 20:02:56.857435 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 13/26] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Aug 5 20:02:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 4175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:02:56.863680 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-4a8533df-8599-4668-897a-bc8831a01446 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:56.865275 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-4a8533df-8599-4668-897a-bc8831a01446 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:56.876109 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4a8533df-8599-4668-897a-bc8831a01446 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:56.876952 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4a8533df-8599-4668-897a-bc8831a01446 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:56.877967 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4a8533df-8599-4668-897a-bc8831a01446 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:56.880502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4a8533df-8599-4668-897a-bc8831a01446 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:56.881351 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4a8533df-8599-4668-897a-bc8831a01446 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:56.881949 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4a8533df-8599-4668-897a-bc8831a01446 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:57.285409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-4a8533df-8599-4668-897a-bc8831a01446 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:57.310608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-4a8533df-8599-4668-897a-bc8831a01446 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1267 microversion: 2.1 time: 0.450565 Aug 05 20:02:57.310946 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 14/27] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:56 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1267 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:02:57.336464 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-159a0768-574d-4b8f-8756-3f65115bc163 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:57.337134 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-159a0768-574d-4b8f-8756-3f65115bc163 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:57.817660 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-159a0768-574d-4b8f-8756-3f65115bc163 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:57.826700 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-159a0768-574d-4b8f-8756-3f65115bc163 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1222 microversion: 2.1 time: 0.498454 Aug 05 20:02:57.827300 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 15/28] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:57 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1222 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:02:58.334669 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-116d188f-8dcf-460c-ab4a-f4b65fe97b22 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:58.335675 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-116d188f-8dcf-460c-ab4a-f4b65fe97b22 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:58.350813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-116d188f-8dcf-460c-ab4a-f4b65fe97b22 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:58.353185 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-116d188f-8dcf-460c-ab4a-f4b65fe97b22 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:58.353860 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-116d188f-8dcf-460c-ab4a-f4b65fe97b22 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:58.358582 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-116d188f-8dcf-460c-ab4a-f4b65fe97b22 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:58.360206 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-116d188f-8dcf-460c-ab4a-f4b65fe97b22 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:58.365238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-116d188f-8dcf-460c-ab4a-f4b65fe97b22 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:58.512104 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-116d188f-8dcf-460c-ab4a-f4b65fe97b22 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:58.520029 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-116d188f-8dcf-460c-ab4a-f4b65fe97b22 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1273 microversion: 2.1 time: 0.190317 Aug 05 20:02:58.523828 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 16/29] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:58 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1273 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:02:58.847717 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-79486a5e-9bef-488a-9fb7-c98ec19e629c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:58.848345 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-79486a5e-9bef-488a-9fb7-c98ec19e629c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:58.868264 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-79486a5e-9bef-488a-9fb7-c98ec19e629c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:58.869425 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-79486a5e-9bef-488a-9fb7-c98ec19e629c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:58.870019 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-79486a5e-9bef-488a-9fb7-c98ec19e629c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:58.870895 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-79486a5e-9bef-488a-9fb7-c98ec19e629c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:58.871495 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-79486a5e-9bef-488a-9fb7-c98ec19e629c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:58.875749 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-79486a5e-9bef-488a-9fb7-c98ec19e629c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:58.982540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-6f541dc1-cda1-4664-9a58-10363183a4ee tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Flavor limits 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:02:58.983573 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-6f541dc1-cda1-4664-9a58-10363183a4ee tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Image limits 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:02:58.984192 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-6f541dc1-cda1-4664-9a58-10363183a4ee tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Flavor pref 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:02:58.984651 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-6f541dc1-cda1-4664-9a58-10363183a4ee tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Image pref 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:02:58.985133 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-6f541dc1-cda1-4664-9a58-10363183a4ee tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:02:59.000020 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6f541dc1-cda1-4664-9a58-10363183a4ee tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:59.000531 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6f541dc1-cda1-4664-9a58-10363183a4ee tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:59.001207 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6f541dc1-cda1-4664-9a58-10363183a4ee tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:59.002137 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6f541dc1-cda1-4664-9a58-10363183a4ee tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:59.002749 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6f541dc1-cda1-4664-9a58-10363183a4ee tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:59.003190 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6f541dc1-cda1-4664-9a58-10363183a4ee tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:59.068337 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-6f541dc1-cda1-4664-9a58-10363183a4ee tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Getting quotas for project 5b265913f9bd46b9b36c18d567d0cf66. Resources: {'cores', 'ram', 'instances'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:02:59.080243 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-6f541dc1-cda1-4664-9a58-10363183a4ee tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Getting quotas for user 1afe13c8fbb1468b8ef3d0d0c671208d and project 5b265913f9bd46b9b36c18d567d0cf66. Resources: {'cores', 'ram', 'instances'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:02:59.083526 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-79486a5e-9bef-488a-9fb7-c98ec19e629c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:02:59.100933 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-79486a5e-9bef-488a-9fb7-c98ec19e629c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1282 microversion: 2.1 time: 0.257409 Aug 05 20:02:59.106108 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 17/30] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:58 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1282 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:02:59.130771 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-6f541dc1-cda1-4664-9a58-10363183a4ee tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Going to run 1 instances... {{(pid=118192) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:02:59.139773 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-6f541dc1-cda1-4664-9a58-10363183a4ee tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c148255e-9574-4d10-b9bb-13c9411eda77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:02:59.294264 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-6f541dc1-cda1-4664-9a58-10363183a4ee tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.337559 Aug 05 20:02:59.296908 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 14/31] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Aug 5 20:02:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 3341 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:02:59.307702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9310a206-34da-4e7c-9c10-2b78208d6e24 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:59.308788 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-9310a206-34da-4e7c-9c10-2b78208d6e24 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:59.551478 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-da80b482-c3b9-4ca5-a297-8c046e9c35df tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:02:59.552289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-da80b482-c3b9-4ca5-a297-8c046e9c35df tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:02:59.582722 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-da80b482-c3b9-4ca5-a297-8c046e9c35df tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:59.584324 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-da80b482-c3b9-4ca5-a297-8c046e9c35df tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:59.585612 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-da80b482-c3b9-4ca5-a297-8c046e9c35df tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:02:59.587018 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-da80b482-c3b9-4ca5-a297-8c046e9c35df tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:02:59.589292 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-da80b482-c3b9-4ca5-a297-8c046e9c35df tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:02:59.592396 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-da80b482-c3b9-4ca5-a297-8c046e9c35df tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:00.309964 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9310a206-34da-4e7c-9c10-2b78208d6e24 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:00.319764 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-9310a206-34da-4e7c-9c10-2b78208d6e24 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1241 microversion: 2.1 time: 1.016597 Aug 05 20:03:00.326744 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 18/32] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:59 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1241 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:00.352692 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a9d02cef-8f47-4ba3-b138-d0ce3dc6b9c8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:00.356865 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-a9d02cef-8f47-4ba3-b138-d0ce3dc6b9c8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:00.375755 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a9d02cef-8f47-4ba3-b138-d0ce3dc6b9c8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:00.377709 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a9d02cef-8f47-4ba3-b138-d0ce3dc6b9c8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:00.378337 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a9d02cef-8f47-4ba3-b138-d0ce3dc6b9c8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:00.382191 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a9d02cef-8f47-4ba3-b138-d0ce3dc6b9c8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:00.385159 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a9d02cef-8f47-4ba3-b138-d0ce3dc6b9c8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:00.388147 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a9d02cef-8f47-4ba3-b138-d0ce3dc6b9c8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:00.511350 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-da80b482-c3b9-4ca5-a297-8c046e9c35df tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:00.570366 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-da80b482-c3b9-4ca5-a297-8c046e9c35df tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1273 microversion: 2.1 time: 1.026380 Aug 05 20:03:00.575216 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 15/33] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:02:59 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1273 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:00.762969 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a9d02cef-8f47-4ba3-b138-d0ce3dc6b9c8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:00.810709 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-a9d02cef-8f47-4ba3-b138-d0ce3dc6b9c8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1280 microversion: 2.1 time: 0.479744 Aug 05 20:03:00.815030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 19/34] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:00 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1280 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:01.350956 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-293268c1-08ac-49d7-848a-a2011e700cba tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:01.351742 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-293268c1-08ac-49d7-848a-a2011e700cba tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:01.367420 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-293268c1-08ac-49d7-848a-a2011e700cba tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:01.371308 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-293268c1-08ac-49d7-848a-a2011e700cba tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:01.372041 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-293268c1-08ac-49d7-848a-a2011e700cba tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:01.376935 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-293268c1-08ac-49d7-848a-a2011e700cba tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:01.377779 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-293268c1-08ac-49d7-848a-a2011e700cba tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:01.379378 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-293268c1-08ac-49d7-848a-a2011e700cba tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:01.543850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-293268c1-08ac-49d7-848a-a2011e700cba tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:01.557628 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-293268c1-08ac-49d7-848a-a2011e700cba tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1293 microversion: 2.1 time: 0.210176 Aug 05 20:03:01.559741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 16/35] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:01 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1293 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:01.594692 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7947df64-20f6-4ef4-8a36-7756a6cf892d tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:01.595567 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-7947df64-20f6-4ef4-8a36-7756a6cf892d tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:01.620133 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7947df64-20f6-4ef4-8a36-7756a6cf892d tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:01.621600 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7947df64-20f6-4ef4-8a36-7756a6cf892d tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:01.622682 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7947df64-20f6-4ef4-8a36-7756a6cf892d tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:01.623672 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7947df64-20f6-4ef4-8a36-7756a6cf892d tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:01.624883 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7947df64-20f6-4ef4-8a36-7756a6cf892d tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:01.625669 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7947df64-20f6-4ef4-8a36-7756a6cf892d tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:01.841561 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-cb875684-0c1c-421a-b2a8-b6b80765c197 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:01.842473 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-cb875684-0c1c-421a-b2a8-b6b80765c197 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:01.859882 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cb875684-0c1c-421a-b2a8-b6b80765c197 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:01.860748 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cb875684-0c1c-421a-b2a8-b6b80765c197 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:01.861299 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cb875684-0c1c-421a-b2a8-b6b80765c197 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:01.864802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cb875684-0c1c-421a-b2a8-b6b80765c197 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:01.865638 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cb875684-0c1c-421a-b2a8-b6b80765c197 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:01.867529 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cb875684-0c1c-421a-b2a8-b6b80765c197 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:02.172112 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-cb875684-0c1c-421a-b2a8-b6b80765c197 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:02.187915 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-cb875684-0c1c-421a-b2a8-b6b80765c197 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1280 microversion: 2.1 time: 0.346241 Aug 05 20:03:02.189168 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 17/36] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:01 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1280 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:02.209540 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-7947df64-20f6-4ef4-8a36-7756a6cf892d tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:02.228542 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-7947df64-20f6-4ef4-8a36-7756a6cf892d tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 0.637572 Aug 05 20:03:02.230600 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 20/37] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:01 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:02.584117 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-22c8d1f9-39bb-4598-889d-3d843fbe0af6 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:02.588160 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-22c8d1f9-39bb-4598-889d-3d843fbe0af6 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:02.599023 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-22c8d1f9-39bb-4598-889d-3d843fbe0af6 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:02.605920 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-22c8d1f9-39bb-4598-889d-3d843fbe0af6 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:02.606640 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-22c8d1f9-39bb-4598-889d-3d843fbe0af6 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:02.607580 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-22c8d1f9-39bb-4598-889d-3d843fbe0af6 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:02.608217 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-22c8d1f9-39bb-4598-889d-3d843fbe0af6 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:02.608838 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-22c8d1f9-39bb-4598-889d-3d843fbe0af6 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:03.211035 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a9b5f302-1069-4cc9-8f19-9e6ec9053a2f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:03.212365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-a9b5f302-1069-4cc9-8f19-9e6ec9053a2f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:03.228536 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a9b5f302-1069-4cc9-8f19-9e6ec9053a2f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:03.229318 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a9b5f302-1069-4cc9-8f19-9e6ec9053a2f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:03.230272 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a9b5f302-1069-4cc9-8f19-9e6ec9053a2f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:03.231293 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a9b5f302-1069-4cc9-8f19-9e6ec9053a2f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:03.236936 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a9b5f302-1069-4cc9-8f19-9e6ec9053a2f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:03.238365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a9b5f302-1069-4cc9-8f19-9e6ec9053a2f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:03.385023 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-22c8d1f9-39bb-4598-889d-3d843fbe0af6 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:03.413281 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-22c8d1f9-39bb-4598-889d-3d843fbe0af6 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1311 microversion: 2.1 time: 0.832042 Aug 05 20:03:03.418047 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 18/38] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:02 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1311 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:03.450338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-0c9cb393-6dcd-4c87-9b3d-a93f6b81fcf1 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:03.451594 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-0c9cb393-6dcd-4c87-9b3d-a93f6b81fcf1 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:03.470127 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0c9cb393-6dcd-4c87-9b3d-a93f6b81fcf1 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:03.473487 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0c9cb393-6dcd-4c87-9b3d-a93f6b81fcf1 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:03.474253 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0c9cb393-6dcd-4c87-9b3d-a93f6b81fcf1 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:03.475324 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0c9cb393-6dcd-4c87-9b3d-a93f6b81fcf1 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:03.477742 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0c9cb393-6dcd-4c87-9b3d-a93f6b81fcf1 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:03.478526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0c9cb393-6dcd-4c87-9b3d-a93f6b81fcf1 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:04.904009 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a9b5f302-1069-4cc9-8f19-9e6ec9053a2f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:04.913847 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-a9b5f302-1069-4cc9-8f19-9e6ec9053a2f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 1.708157 Aug 05 20:03:04.925924 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 21/39] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:03 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:04.962265 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-d29b7e67-70eb-4412-84f0-8615fe2f92a2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:04.967725 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-d29b7e67-70eb-4412-84f0-8615fe2f92a2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:04.976531 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d29b7e67-70eb-4412-84f0-8615fe2f92a2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:04.977384 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d29b7e67-70eb-4412-84f0-8615fe2f92a2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:04.978114 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d29b7e67-70eb-4412-84f0-8615fe2f92a2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:04.979062 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d29b7e67-70eb-4412-84f0-8615fe2f92a2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:04.979713 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d29b7e67-70eb-4412-84f0-8615fe2f92a2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:04.993963 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d29b7e67-70eb-4412-84f0-8615fe2f92a2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:05.484097 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-0c9cb393-6dcd-4c87-9b3d-a93f6b81fcf1 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:05.498571 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-0c9cb393-6dcd-4c87-9b3d-a93f6b81fcf1 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 2.073702 Aug 05 20:03:05.499097 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 19/40] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:03 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 2080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:05.528407 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-d29b7e67-70eb-4412-84f0-8615fe2f92a2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:05.537618 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-d29b7e67-70eb-4412-84f0-8615fe2f92a2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1299 microversion: 2.1 time: 0.594711 Aug 05 20:03:05.541988 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 22/41] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:04 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1299 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:05.938906 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-fd064749-fc9e-4b19-9bdb-e9b06365dba5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:05.940687 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-fd064749-fc9e-4b19-9bdb-e9b06365dba5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:05.967630 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fd064749-fc9e-4b19-9bdb-e9b06365dba5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:05.980130 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fd064749-fc9e-4b19-9bdb-e9b06365dba5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:05.983499 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fd064749-fc9e-4b19-9bdb-e9b06365dba5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:05.990101 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fd064749-fc9e-4b19-9bdb-e9b06365dba5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:05.990854 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fd064749-fc9e-4b19-9bdb-e9b06365dba5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:05.998949 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fd064749-fc9e-4b19-9bdb-e9b06365dba5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:06.250263 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-6ac5921d-b1bf-4577-b232-5a2ee31879ea req-537da1cd-5aa8-47f5-bacd-f6a2ece50810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaafcd0b-5f14-4973-8cc5-274510846bc2", "tag": "ee1754c1-6ea5-469b-8697-519cd9b01157"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:03:06.283005 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-6ac5921d-b1bf-4577-b232-5a2ee31879ea req-537da1cd-5aa8-47f5-bacd-f6a2ece50810 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:06.284140 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-6ac5921d-b1bf-4577-b232-5a2ee31879ea req-537da1cd-5aa8-47f5-bacd-f6a2ece50810 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:06.285708 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-6ac5921d-b1bf-4577-b232-5a2ee31879ea req-537da1cd-5aa8-47f5-bacd-f6a2ece50810 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:06.365440 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-6ac5921d-b1bf-4577-b232-5a2ee31879ea req-537da1cd-5aa8-47f5-bacd-f6a2ece50810 service nova] Creating event network-changed:ee1754c1-6ea5-469b-8697-519cd9b01157 for instance eaafcd0b-5f14-4973-8cc5-274510846bc2 on hv-cinder-85221 Aug 05 20:03:06.366657 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-6ac5921d-b1bf-4577-b232-5a2ee31879ea req-537da1cd-5aa8-47f5-bacd-f6a2ece50810 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118192) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 05 20:03:06.367297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-6ac5921d-b1bf-4577-b232-5a2ee31879ea req-537da1cd-5aa8-47f5-bacd-f6a2ece50810 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118192) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 05 20:03:06.369681 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2b7220f2-f667-4f5d-9200-dfa14d3383e0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:06.371352 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2b7220f2-f667-4f5d-9200-dfa14d3383e0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:06.372693 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2b7220f2-f667-4f5d-9200-dfa14d3383e0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:06.375278 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2b7220f2-f667-4f5d-9200-dfa14d3383e0 None None] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:06.376479 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2b7220f2-f667-4f5d-9200-dfa14d3383e0 None None] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:06.377543 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2b7220f2-f667-4f5d-9200-dfa14d3383e0 None None] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:06.431726 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.compute.rpcapi [None req-2b7220f2-f667-4f5d-9200-dfa14d3383e0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 05 20:03:06.441597 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2b7220f2-f667-4f5d-9200-dfa14d3383e0 None None] Releasing lock "compute-rpcapi-router" {{(pid=118192) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 05 20:03:06.487519 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-2b7220f2-f667-4f5d-9200-dfa14d3383e0 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.986362 Aug 05 20:03:06.489494 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 20/42] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:03:06.526141 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-87f22c39-44a2-4be6-a203-15ccc26bbf28 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:06.526855 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-87f22c39-44a2-4be6-a203-15ccc26bbf28 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:06.540269 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-87f22c39-44a2-4be6-a203-15ccc26bbf28 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:06.540787 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-87f22c39-44a2-4be6-a203-15ccc26bbf28 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:06.541585 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-87f22c39-44a2-4be6-a203-15ccc26bbf28 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:06.549787 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-87f22c39-44a2-4be6-a203-15ccc26bbf28 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:06.551322 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-87f22c39-44a2-4be6-a203-15ccc26bbf28 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:06.552227 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-87f22c39-44a2-4be6-a203-15ccc26bbf28 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:06.669211 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=4 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:03:06.914919 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-fd064749-fc9e-4b19-9bdb-e9b06365dba5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:06.931586 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-fd064749-fc9e-4b19-9bdb-e9b06365dba5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.997414 Aug 05 20:03:06.933690 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 23/43] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:05 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:06.944299 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-d64a7e32-1ab2-4bd6-97cb-053896f07eb3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:06.950422 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-d64a7e32-1ab2-4bd6-97cb-053896f07eb3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:06.969267 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d64a7e32-1ab2-4bd6-97cb-053896f07eb3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:06.970946 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d64a7e32-1ab2-4bd6-97cb-053896f07eb3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:06.977937 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d64a7e32-1ab2-4bd6-97cb-053896f07eb3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:06.982247 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d64a7e32-1ab2-4bd6-97cb-053896f07eb3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:06.989306 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d64a7e32-1ab2-4bd6-97cb-053896f07eb3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:06.992992 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d64a7e32-1ab2-4bd6-97cb-053896f07eb3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:07.359897 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-d64a7e32-1ab2-4bd6-97cb-053896f07eb3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:07.369197 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-d64a7e32-1ab2-4bd6-97cb-053896f07eb3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1299 microversion: 2.1 time: 0.434090 Aug 05 20:03:07.373115 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 24/44] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:06 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1299 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:07.598530 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-87f22c39-44a2-4be6-a203-15ccc26bbf28 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:07.607430 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-87f22c39-44a2-4be6-a203-15ccc26bbf28 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 1.085887 Aug 05 20:03:07.631215 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 21/45] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:06 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:07.957312 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-d70c8e27-9d40-45ba-a4d5-bb6dfc994b66 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:07.958109 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-d70c8e27-9d40-45ba-a4d5-bb6dfc994b66 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:07.966409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d70c8e27-9d40-45ba-a4d5-bb6dfc994b66 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:07.966911 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d70c8e27-9d40-45ba-a4d5-bb6dfc994b66 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:07.967351 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d70c8e27-9d40-45ba-a4d5-bb6dfc994b66 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:07.969318 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d70c8e27-9d40-45ba-a4d5-bb6dfc994b66 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:07.969797 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d70c8e27-9d40-45ba-a4d5-bb6dfc994b66 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:07.970227 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d70c8e27-9d40-45ba-a4d5-bb6dfc994b66 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:08.950942 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-84a10f96-4f76-42bc-b5d1-d61f6655e870 req-261d8d86-3a32-4a8e-ba7e-b6583cb70508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03228f62-79c6-41a8-9f85-256350c24645", "tag": "232c6be7-dcbd-4144-841f-4ab31b81702b"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:03:09.017031 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-84a10f96-4f76-42bc-b5d1-d61f6655e870 req-261d8d86-3a32-4a8e-ba7e-b6583cb70508 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:09.019478 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-84a10f96-4f76-42bc-b5d1-d61f6655e870 req-261d8d86-3a32-4a8e-ba7e-b6583cb70508 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:09.020112 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-84a10f96-4f76-42bc-b5d1-d61f6655e870 req-261d8d86-3a32-4a8e-ba7e-b6583cb70508 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:09.078403 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-84a10f96-4f76-42bc-b5d1-d61f6655e870 req-261d8d86-3a32-4a8e-ba7e-b6583cb70508 service nova] Creating event network-changed:232c6be7-dcbd-4144-841f-4ab31b81702b for instance 03228f62-79c6-41a8-9f85-256350c24645 on hv-cinder-85221 Aug 05 20:03:09.091802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-84a10f96-4f76-42bc-b5d1-d61f6655e870 req-261d8d86-3a32-4a8e-ba7e-b6583cb70508 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.880623 Aug 05 20:03:09.096879 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 22/46] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:03:09.111057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-01cfa7c2-fa60-4c5c-9815-cae4252820c6 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:09.114327 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-01cfa7c2-fa60-4c5c-9815-cae4252820c6 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:09.127427 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell0:SELECT=20 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:03:09.132309 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-01cfa7c2-fa60-4c5c-9815-cae4252820c6 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:09.133304 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-01cfa7c2-fa60-4c5c-9815-cae4252820c6 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:09.133764 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-01cfa7c2-fa60-4c5c-9815-cae4252820c6 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:09.136865 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-01cfa7c2-fa60-4c5c-9815-cae4252820c6 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:09.137345 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-01cfa7c2-fa60-4c5c-9815-cae4252820c6 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:09.140274 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-01cfa7c2-fa60-4c5c-9815-cae4252820c6 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:09.233228 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-d70c8e27-9d40-45ba-a4d5-bb6dfc994b66 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:09.250767 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-d70c8e27-9d40-45ba-a4d5-bb6dfc994b66 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 1.297189 Aug 05 20:03:09.255264 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 25/47] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:07 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:09.273128 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-c9e2976d-b7f5-4029-a9c6-e624e2db3442 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:09.276056 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-c9e2976d-b7f5-4029-a9c6-e624e2db3442 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:09.291546 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c9e2976d-b7f5-4029-a9c6-e624e2db3442 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:09.292052 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c9e2976d-b7f5-4029-a9c6-e624e2db3442 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:09.295363 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c9e2976d-b7f5-4029-a9c6-e624e2db3442 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:09.296663 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c9e2976d-b7f5-4029-a9c6-e624e2db3442 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:09.297163 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c9e2976d-b7f5-4029-a9c6-e624e2db3442 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:09.297631 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c9e2976d-b7f5-4029-a9c6-e624e2db3442 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:10.067642 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-01cfa7c2-fa60-4c5c-9815-cae4252820c6 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:10.096494 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-01cfa7c2-fa60-4c5c-9815-cae4252820c6 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.981569 Aug 05 20:03:10.108941 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 23/48] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:09 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:10.274937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-dce67b14-a758-49be-856b-1bd84aebc648 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:10.275403 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-dce67b14-a758-49be-856b-1bd84aebc648 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:10.304270 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dce67b14-a758-49be-856b-1bd84aebc648 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:10.305176 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dce67b14-a758-49be-856b-1bd84aebc648 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:10.310289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dce67b14-a758-49be-856b-1bd84aebc648 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:10.312183 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dce67b14-a758-49be-856b-1bd84aebc648 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:10.316983 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=18 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:03:10.317590 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dce67b14-a758-49be-856b-1bd84aebc648 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:10.318169 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dce67b14-a758-49be-856b-1bd84aebc648 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:10.389893 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-c9e2976d-b7f5-4029-a9c6-e624e2db3442 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:10.420150 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-c9e2976d-b7f5-4029-a9c6-e624e2db3442 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 1.163470 Aug 05 20:03:10.426016 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 26/49] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:09 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:10.975505 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-dce67b14-a758-49be-856b-1bd84aebc648 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:10.995206 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-dce67b14-a758-49be-856b-1bd84aebc648 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.725097 Aug 05 20:03:10.998156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 24/50] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:10 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:11.122582 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9ce8d701-74dc-42b8-ad08-3a75ac74f373 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:11.123214 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-9ce8d701-74dc-42b8-ad08-3a75ac74f373 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:11.135284 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9ce8d701-74dc-42b8-ad08-3a75ac74f373 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:11.135798 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9ce8d701-74dc-42b8-ad08-3a75ac74f373 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:11.136246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9ce8d701-74dc-42b8-ad08-3a75ac74f373 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:11.136997 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9ce8d701-74dc-42b8-ad08-3a75ac74f373 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:11.138783 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9ce8d701-74dc-42b8-ad08-3a75ac74f373 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:11.139232 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9ce8d701-74dc-42b8-ad08-3a75ac74f373 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:11.227935 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-5f579f1f-6f84-4fd3-9b04-6cd6daeed67a req-f7bf7ab0-3cdf-4145-aa39-43674975fafd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d", "tag": "d0ef51ee-a75a-482b-8bfb-3cb689fe05cd"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:03:11.242354 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-5f579f1f-6f84-4fd3-9b04-6cd6daeed67a req-f7bf7ab0-3cdf-4145-aa39-43674975fafd service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:11.243146 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-5f579f1f-6f84-4fd3-9b04-6cd6daeed67a req-f7bf7ab0-3cdf-4145-aa39-43674975fafd service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:11.243684 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-5f579f1f-6f84-4fd3-9b04-6cd6daeed67a req-f7bf7ab0-3cdf-4145-aa39-43674975fafd service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:11.259688 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-5f579f1f-6f84-4fd3-9b04-6cd6daeed67a req-f7bf7ab0-3cdf-4145-aa39-43674975fafd service nova] Creating event network-changed:d0ef51ee-a75a-482b-8bfb-3cb689fe05cd for instance c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d on hv-cinder-85221 Aug 05 20:03:11.265029 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-5f579f1f-6f84-4fd3-9b04-6cd6daeed67a req-f7bf7ab0-3cdf-4145-aa39-43674975fafd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043957 Aug 05 20:03:11.265635 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 25/51] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:03:11.459065 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-77dc3a63-acc4-4c18-a7bd-977997efa133 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:11.462106 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-77dc3a63-acc4-4c18-a7bd-977997efa133 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:11.496407 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9ce8d701-74dc-42b8-ad08-3a75ac74f373 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:11.507860 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-77dc3a63-acc4-4c18-a7bd-977997efa133 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:11.509459 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-77dc3a63-acc4-4c18-a7bd-977997efa133 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:11.510326 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-77dc3a63-acc4-4c18-a7bd-977997efa133 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:11.511449 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-77dc3a63-acc4-4c18-a7bd-977997efa133 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:11.512967 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-77dc3a63-acc4-4c18-a7bd-977997efa133 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:11.514160 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-77dc3a63-acc4-4c18-a7bd-977997efa133 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:11.539180 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-9ce8d701-74dc-42b8-ad08-3a75ac74f373 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.419262 Aug 05 20:03:11.554093 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 27/52] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:11 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:11.870583 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-77dc3a63-acc4-4c18-a7bd-977997efa133 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:11.880978 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-77dc3a63-acc4-4c18-a7bd-977997efa133 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 0.436289 Aug 05 20:03:11.886320 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 26/53] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:11 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:12.021096 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-eca9d6d4-a80b-4c36-a6ae-293e9a7a1e32 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:12.022214 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-eca9d6d4-a80b-4c36-a6ae-293e9a7a1e32 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:12.036063 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eca9d6d4-a80b-4c36-a6ae-293e9a7a1e32 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:12.037783 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eca9d6d4-a80b-4c36-a6ae-293e9a7a1e32 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:12.038226 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eca9d6d4-a80b-4c36-a6ae-293e9a7a1e32 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:12.039927 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eca9d6d4-a80b-4c36-a6ae-293e9a7a1e32 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:12.041341 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eca9d6d4-a80b-4c36-a6ae-293e9a7a1e32 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:12.043061 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eca9d6d4-a80b-4c36-a6ae-293e9a7a1e32 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:12.370012 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-eca9d6d4-a80b-4c36-a6ae-293e9a7a1e32 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:12.378012 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-eca9d6d4-a80b-4c36-a6ae-293e9a7a1e32 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.362936 Aug 05 20:03:12.378924 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 28/54] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:12 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:12.565241 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-62f8e51d-2784-419b-809c-7f43f98006f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:12.566291 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-62f8e51d-2784-419b-809c-7f43f98006f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:12.575751 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-62f8e51d-2784-419b-809c-7f43f98006f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:12.578376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-62f8e51d-2784-419b-809c-7f43f98006f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:12.579366 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-62f8e51d-2784-419b-809c-7f43f98006f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:12.580658 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-62f8e51d-2784-419b-809c-7f43f98006f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:12.581245 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-62f8e51d-2784-419b-809c-7f43f98006f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:12.581877 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-62f8e51d-2784-419b-809c-7f43f98006f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:12.911781 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-404628a4-c7b0-4e85-b34a-62821f15c1cf tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:12.912994 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-404628a4-c7b0-4e85-b34a-62821f15c1cf tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:12.920952 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:03:12.923705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-404628a4-c7b0-4e85-b34a-62821f15c1cf tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:12.927213 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-404628a4-c7b0-4e85-b34a-62821f15c1cf tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:12.928060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-404628a4-c7b0-4e85-b34a-62821f15c1cf tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:12.929595 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-404628a4-c7b0-4e85-b34a-62821f15c1cf tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:12.931354 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-404628a4-c7b0-4e85-b34a-62821f15c1cf tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:12.936338 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-404628a4-c7b0-4e85-b34a-62821f15c1cf tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:12.945268 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=83 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:03:13.307587 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-62f8e51d-2784-419b-809c-7f43f98006f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:13.327567 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-62f8e51d-2784-419b-809c-7f43f98006f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.767902 Aug 05 20:03:13.330261 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 27/55] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:12 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:13.337327 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-4c4130e6-6121-41c6-a0de-7db96b2bd863 req-f83ccdb3-b092-419b-b522-272e46eaf181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24ea172c-d11f-41e4-80d8-3f3e5f67cf90", "tag": "9d6aae7f-84e8-487b-8606-59afea4d7fad"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:03:13.352882 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-4c4130e6-6121-41c6-a0de-7db96b2bd863 req-f83ccdb3-b092-419b-b522-272e46eaf181 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:13.353722 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-4c4130e6-6121-41c6-a0de-7db96b2bd863 req-f83ccdb3-b092-419b-b522-272e46eaf181 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:13.354791 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-4c4130e6-6121-41c6-a0de-7db96b2bd863 req-f83ccdb3-b092-419b-b522-272e46eaf181 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:13.371514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-4c4130e6-6121-41c6-a0de-7db96b2bd863 req-f83ccdb3-b092-419b-b522-272e46eaf181 service nova] Creating event network-changed:9d6aae7f-84e8-487b-8606-59afea4d7fad for instance 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 on hv-cinder-85221 Aug 05 20:03:13.379044 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-4c4130e6-6121-41c6-a0de-7db96b2bd863 req-f83ccdb3-b092-419b-b522-272e46eaf181 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046249 Aug 05 20:03:13.386903 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 28/56] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:03:13.402785 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-417e0492-ad6e-450a-b842-809df792d0dc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:13.404270 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-417e0492-ad6e-450a-b842-809df792d0dc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:13.409816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-404628a4-c7b0-4e85-b34a-62821f15c1cf tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:13.414602 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-417e0492-ad6e-450a-b842-809df792d0dc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:13.415196 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-417e0492-ad6e-450a-b842-809df792d0dc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:13.415703 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-417e0492-ad6e-450a-b842-809df792d0dc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:13.416480 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-417e0492-ad6e-450a-b842-809df792d0dc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:13.417273 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-417e0492-ad6e-450a-b842-809df792d0dc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:13.418178 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-417e0492-ad6e-450a-b842-809df792d0dc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:13.420156 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-404628a4-c7b0-4e85-b34a-62821f15c1cf tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 0.512820 Aug 05 20:03:13.421141 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 29/57] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:12 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:13.595368 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-417e0492-ad6e-450a-b842-809df792d0dc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:13.604589 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-417e0492-ad6e-450a-b842-809df792d0dc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.208055 Aug 05 20:03:13.605178 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 29/58] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:13 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:14.352389 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f3326396-9a44-4003-95ed-bec054522b85 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:14.354326 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f3326396-9a44-4003-95ed-bec054522b85 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:14.365888 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f3326396-9a44-4003-95ed-bec054522b85 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:14.367012 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f3326396-9a44-4003-95ed-bec054522b85 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:14.367659 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f3326396-9a44-4003-95ed-bec054522b85 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:14.369163 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f3326396-9a44-4003-95ed-bec054522b85 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:14.369865 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f3326396-9a44-4003-95ed-bec054522b85 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:14.370637 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f3326396-9a44-4003-95ed-bec054522b85 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:14.443714 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-fcf017bd-9f39-4b30-8071-880f9feaaff9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:14.444883 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-fcf017bd-9f39-4b30-8071-880f9feaaff9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:14.453618 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:03:14.456959 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fcf017bd-9f39-4b30-8071-880f9feaaff9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:14.457813 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fcf017bd-9f39-4b30-8071-880f9feaaff9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:14.458585 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fcf017bd-9f39-4b30-8071-880f9feaaff9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:14.460300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fcf017bd-9f39-4b30-8071-880f9feaaff9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:14.461270 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fcf017bd-9f39-4b30-8071-880f9feaaff9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:14.462604 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fcf017bd-9f39-4b30-8071-880f9feaaff9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:14.477509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=81 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:03:14.653591 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f3326396-9a44-4003-95ed-bec054522b85 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:14.660651 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f3326396-9a44-4003-95ed-bec054522b85 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.313797 Aug 05 20:03:14.677013 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 30/59] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:14 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:14.683689 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-19153b35-fbba-4781-a190-68f4b292535f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:14.684531 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-19153b35-fbba-4781-a190-68f4b292535f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:14.694030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-19153b35-fbba-4781-a190-68f4b292535f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:14.695270 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-19153b35-fbba-4781-a190-68f4b292535f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:14.696044 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-19153b35-fbba-4781-a190-68f4b292535f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:14.697315 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-19153b35-fbba-4781-a190-68f4b292535f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:14.698412 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-19153b35-fbba-4781-a190-68f4b292535f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:14.698987 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-19153b35-fbba-4781-a190-68f4b292535f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:14.750363 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-fcf017bd-9f39-4b30-8071-880f9feaaff9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:14.759884 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-fcf017bd-9f39-4b30-8071-880f9feaaff9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 0.322694 Aug 05 20:03:14.760720 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 30/60] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:14 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:14.888803 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-19153b35-fbba-4781-a190-68f4b292535f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:14.900470 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-19153b35-fbba-4781-a190-68f4b292535f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.221654 Aug 05 20:03:14.901634 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 31/61] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:14 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:15.684885 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-59dbd3a6-be59-4715-b107-5194cecaaaaf tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:15.685951 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-59dbd3a6-be59-4715-b107-5194cecaaaaf tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:15.697757 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-59dbd3a6-be59-4715-b107-5194cecaaaaf tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:15.698177 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-59dbd3a6-be59-4715-b107-5194cecaaaaf tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:15.698674 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-59dbd3a6-be59-4715-b107-5194cecaaaaf tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:15.703390 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-59dbd3a6-be59-4715-b107-5194cecaaaaf tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:15.704024 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-59dbd3a6-be59-4715-b107-5194cecaaaaf tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:15.705273 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-59dbd3a6-be59-4715-b107-5194cecaaaaf tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:15.781843 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-20616921-8138-4aaa-a57a-ce931ca62de3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:15.782457 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-20616921-8138-4aaa-a57a-ce931ca62de3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:15.790460 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-20616921-8138-4aaa-a57a-ce931ca62de3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:15.793032 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-20616921-8138-4aaa-a57a-ce931ca62de3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:15.793832 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-20616921-8138-4aaa-a57a-ce931ca62de3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:15.794760 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-20616921-8138-4aaa-a57a-ce931ca62de3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:15.795968 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-20616921-8138-4aaa-a57a-ce931ca62de3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:15.796641 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-20616921-8138-4aaa-a57a-ce931ca62de3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:15.969380 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-59dbd3a6-be59-4715-b107-5194cecaaaaf tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:15.980848 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-59dbd3a6-be59-4715-b107-5194cecaaaaf tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.300619 Aug 05 20:03:15.981928 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 31/62] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:15 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:15.988476 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b1edb32a-bbc3-41e6-8bcb-013ba788a6de tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:15.990332 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-b1edb32a-bbc3-41e6-8bcb-013ba788a6de tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:16.014177 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b1edb32a-bbc3-41e6-8bcb-013ba788a6de tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:16.019284 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b1edb32a-bbc3-41e6-8bcb-013ba788a6de tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:16.021281 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b1edb32a-bbc3-41e6-8bcb-013ba788a6de tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:16.026911 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b1edb32a-bbc3-41e6-8bcb-013ba788a6de tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:16.027758 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b1edb32a-bbc3-41e6-8bcb-013ba788a6de tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:16.029000 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b1edb32a-bbc3-41e6-8bcb-013ba788a6de tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:16.118950 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-20616921-8138-4aaa-a57a-ce931ca62de3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:16.132843 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-20616921-8138-4aaa-a57a-ce931ca62de3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 0.352931 Aug 05 20:03:16.133347 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 32/63] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:15 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:16.381213 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-b1edb32a-bbc3-41e6-8bcb-013ba788a6de tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:16.394164 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b1edb32a-bbc3-41e6-8bcb-013ba788a6de tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.410734 Aug 05 20:03:16.396881 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 32/64] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:15 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:17.003572 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-96ab077a-abb6-40a4-ad6f-e3bb1e99a673 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:17.005779 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-96ab077a-abb6-40a4-ad6f-e3bb1e99a673 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:17.011899 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-96ab077a-abb6-40a4-ad6f-e3bb1e99a673 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:17.012467 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-96ab077a-abb6-40a4-ad6f-e3bb1e99a673 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:17.013008 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-96ab077a-abb6-40a4-ad6f-e3bb1e99a673 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:17.013779 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-96ab077a-abb6-40a4-ad6f-e3bb1e99a673 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:17.014306 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-96ab077a-abb6-40a4-ad6f-e3bb1e99a673 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:17.014977 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-96ab077a-abb6-40a4-ad6f-e3bb1e99a673 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:17.157863 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-521ad222-5f20-47d9-a9b5-dbf5f5e1d064 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:17.160443 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-521ad222-5f20-47d9-a9b5-dbf5f5e1d064 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:17.163139 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell0:SELECT=6 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:03:17.167702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-96ab077a-abb6-40a4-ad6f-e3bb1e99a673 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:17.169558 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-521ad222-5f20-47d9-a9b5-dbf5f5e1d064 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:17.170491 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-521ad222-5f20-47d9-a9b5-dbf5f5e1d064 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:17.173267 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-521ad222-5f20-47d9-a9b5-dbf5f5e1d064 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:17.174373 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-521ad222-5f20-47d9-a9b5-dbf5f5e1d064 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:17.175440 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-521ad222-5f20-47d9-a9b5-dbf5f5e1d064 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:17.176009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-521ad222-5f20-47d9-a9b5-dbf5f5e1d064 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:17.178498 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-96ab077a-abb6-40a4-ad6f-e3bb1e99a673 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.179476 Aug 05 20:03:17.181251 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 33/65] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:16 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:17.380143 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-521ad222-5f20-47d9-a9b5-dbf5f5e1d064 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:17.396546 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-521ad222-5f20-47d9-a9b5-dbf5f5e1d064 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 0.243082 Aug 05 20:03:17.397497 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 33/66] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:17 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:17.430628 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f8773089-5b2e-4daa-ad12-14d770c91e21 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:17.431514 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f8773089-5b2e-4daa-ad12-14d770c91e21 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:17.444096 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f8773089-5b2e-4daa-ad12-14d770c91e21 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:17.444846 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f8773089-5b2e-4daa-ad12-14d770c91e21 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:17.445637 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f8773089-5b2e-4daa-ad12-14d770c91e21 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:17.446674 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f8773089-5b2e-4daa-ad12-14d770c91e21 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:17.447333 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f8773089-5b2e-4daa-ad12-14d770c91e21 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:17.447964 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f8773089-5b2e-4daa-ad12-14d770c91e21 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:17.664189 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f8773089-5b2e-4daa-ad12-14d770c91e21 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:17.675645 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f8773089-5b2e-4daa-ad12-14d770c91e21 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.253179 Aug 05 20:03:17.676250 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 34/67] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:17 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:18.206658 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-662c37e2-027f-46ff-b24c-298f776aa5ce tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:18.209012 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-662c37e2-027f-46ff-b24c-298f776aa5ce tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:18.217293 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-662c37e2-027f-46ff-b24c-298f776aa5ce tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:18.218002 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-662c37e2-027f-46ff-b24c-298f776aa5ce tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:18.218793 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-662c37e2-027f-46ff-b24c-298f776aa5ce tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:18.219837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-662c37e2-027f-46ff-b24c-298f776aa5ce tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:18.220695 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-662c37e2-027f-46ff-b24c-298f776aa5ce tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:18.222678 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-662c37e2-027f-46ff-b24c-298f776aa5ce tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:18.419204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-67d33dfa-e0f0-491f-bf20-85858b4da2e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:18.420090 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-67d33dfa-e0f0-491f-bf20-85858b4da2e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:18.444600 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-67d33dfa-e0f0-491f-bf20-85858b4da2e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:18.444886 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-67d33dfa-e0f0-491f-bf20-85858b4da2e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:18.445583 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-67d33dfa-e0f0-491f-bf20-85858b4da2e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:18.446479 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-67d33dfa-e0f0-491f-bf20-85858b4da2e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:18.447122 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-67d33dfa-e0f0-491f-bf20-85858b4da2e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:18.447739 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-67d33dfa-e0f0-491f-bf20-85858b4da2e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:18.651209 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-662c37e2-027f-46ff-b24c-298f776aa5ce tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:18.659428 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-662c37e2-027f-46ff-b24c-298f776aa5ce tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.460644 Aug 05 20:03:18.660000 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 34/68] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:18 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:18.696297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-66d210f5-cd23-49e0-874b-d4d92b64cfd9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:18.697056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-66d210f5-cd23-49e0-874b-d4d92b64cfd9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:18.710521 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-66d210f5-cd23-49e0-874b-d4d92b64cfd9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:18.711094 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-66d210f5-cd23-49e0-874b-d4d92b64cfd9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:18.711537 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-66d210f5-cd23-49e0-874b-d4d92b64cfd9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:18.712242 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-66d210f5-cd23-49e0-874b-d4d92b64cfd9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:18.712816 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-66d210f5-cd23-49e0-874b-d4d92b64cfd9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:18.713244 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-66d210f5-cd23-49e0-874b-d4d92b64cfd9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:18.868936 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-67d33dfa-e0f0-491f-bf20-85858b4da2e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:18.890707 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-67d33dfa-e0f0-491f-bf20-85858b4da2e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 0.472297 Aug 05 20:03:18.893152 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 35/69] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:18 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:18.987680 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-66d210f5-cd23-49e0-874b-d4d92b64cfd9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:18.998451 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-66d210f5-cd23-49e0-874b-d4d92b64cfd9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.306331 Aug 05 20:03:18.999374 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 35/70] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:18 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:19.681373 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-2a37232a-df5c-4b71-94c8-140a6514940e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:19.682019 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-2a37232a-df5c-4b71-94c8-140a6514940e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:19.691084 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2a37232a-df5c-4b71-94c8-140a6514940e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:19.691971 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2a37232a-df5c-4b71-94c8-140a6514940e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:19.692860 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2a37232a-df5c-4b71-94c8-140a6514940e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:19.693738 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2a37232a-df5c-4b71-94c8-140a6514940e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:19.694424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2a37232a-df5c-4b71-94c8-140a6514940e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:19.695235 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2a37232a-df5c-4b71-94c8-140a6514940e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:19.888204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-2a37232a-df5c-4b71-94c8-140a6514940e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:19.897728 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-2a37232a-df5c-4b71-94c8-140a6514940e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.221215 Aug 05 20:03:19.898646 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 36/71] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:19 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:19.915401 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-3e88be99-6300-438f-b692-fd7ae876ee69 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:19.916111 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-3e88be99-6300-438f-b692-fd7ae876ee69 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:19.923115 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3e88be99-6300-438f-b692-fd7ae876ee69 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:19.923829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3e88be99-6300-438f-b692-fd7ae876ee69 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:19.925086 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3e88be99-6300-438f-b692-fd7ae876ee69 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:19.927921 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3e88be99-6300-438f-b692-fd7ae876ee69 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:19.928452 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3e88be99-6300-438f-b692-fd7ae876ee69 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:19.929169 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3e88be99-6300-438f-b692-fd7ae876ee69 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:20.020662 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7d82fb96-8933-4765-836b-d79d5186e121 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:20.021404 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-7d82fb96-8933-4765-836b-d79d5186e121 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:20.030489 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7d82fb96-8933-4765-836b-d79d5186e121 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:20.032899 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7d82fb96-8933-4765-836b-d79d5186e121 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:20.033422 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7d82fb96-8933-4765-836b-d79d5186e121 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:20.049952 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7d82fb96-8933-4765-836b-d79d5186e121 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:20.050702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7d82fb96-8933-4765-836b-d79d5186e121 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:20.051375 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7d82fb96-8933-4765-836b-d79d5186e121 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:20.169412 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-3e88be99-6300-438f-b692-fd7ae876ee69 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:20.180454 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-3e88be99-6300-438f-b692-fd7ae876ee69 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 0.266473 Aug 05 20:03:20.181317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 36/72] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:19 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:20.259964 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-7d82fb96-8933-4765-836b-d79d5186e121 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:20.267556 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-7d82fb96-8933-4765-836b-d79d5186e121 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.251377 Aug 05 20:03:20.273893 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 37/73] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:20 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:20.918373 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-76291921-ed9c-429a-8821-48019e2df6d4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:20.919661 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-76291921-ed9c-429a-8821-48019e2df6d4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:20.927680 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-76291921-ed9c-429a-8821-48019e2df6d4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:20.928414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-76291921-ed9c-429a-8821-48019e2df6d4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:20.929072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-76291921-ed9c-429a-8821-48019e2df6d4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:20.930002 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-76291921-ed9c-429a-8821-48019e2df6d4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:20.930656 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-76291921-ed9c-429a-8821-48019e2df6d4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:20.931260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-76291921-ed9c-429a-8821-48019e2df6d4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:21.084884 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-76291921-ed9c-429a-8821-48019e2df6d4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:21.093423 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-76291921-ed9c-429a-8821-48019e2df6d4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.178974 Aug 05 20:03:21.094342 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 37/74] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:20 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:21.201630 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-5f9688a4-e547-4b5b-a1a0-38ec7ae40d73 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:21.202849 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-5f9688a4-e547-4b5b-a1a0-38ec7ae40d73 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:21.209995 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5f9688a4-e547-4b5b-a1a0-38ec7ae40d73 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:21.210677 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5f9688a4-e547-4b5b-a1a0-38ec7ae40d73 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:21.211106 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5f9688a4-e547-4b5b-a1a0-38ec7ae40d73 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:21.211808 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5f9688a4-e547-4b5b-a1a0-38ec7ae40d73 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:21.212256 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5f9688a4-e547-4b5b-a1a0-38ec7ae40d73 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:21.212705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5f9688a4-e547-4b5b-a1a0-38ec7ae40d73 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:21.294101 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-143c75e4-2d01-4121-9433-cf4f630bebd8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:21.295302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-143c75e4-2d01-4121-9433-cf4f630bebd8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:21.311038 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-143c75e4-2d01-4121-9433-cf4f630bebd8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:21.311832 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-143c75e4-2d01-4121-9433-cf4f630bebd8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:21.312775 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-143c75e4-2d01-4121-9433-cf4f630bebd8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:21.313803 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-143c75e4-2d01-4121-9433-cf4f630bebd8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:21.314574 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-143c75e4-2d01-4121-9433-cf4f630bebd8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:21.316567 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-143c75e4-2d01-4121-9433-cf4f630bebd8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:21.369384 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-5f9688a4-e547-4b5b-a1a0-38ec7ae40d73 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:21.376984 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-5f9688a4-e547-4b5b-a1a0-38ec7ae40d73 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 0.179131 Aug 05 20:03:21.377626 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 38/75] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:21 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:21.482266 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-143c75e4-2d01-4121-9433-cf4f630bebd8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:21.490656 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-143c75e4-2d01-4121-9433-cf4f630bebd8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.201245 Aug 05 20:03:21.496916 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 38/76] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:21 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:22.114447 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-ee575051-83f0-414c-9940-e24e2b926334 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:22.115362 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-ee575051-83f0-414c-9940-e24e2b926334 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:22.122098 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ee575051-83f0-414c-9940-e24e2b926334 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:22.122797 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ee575051-83f0-414c-9940-e24e2b926334 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:22.123242 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ee575051-83f0-414c-9940-e24e2b926334 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:22.123945 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ee575051-83f0-414c-9940-e24e2b926334 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:22.124396 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ee575051-83f0-414c-9940-e24e2b926334 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:22.125100 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ee575051-83f0-414c-9940-e24e2b926334 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:22.277045 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-ee575051-83f0-414c-9940-e24e2b926334 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:22.286549 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-ee575051-83f0-414c-9940-e24e2b926334 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.176009 Aug 05 20:03:22.287588 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 39/77] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:22 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:22.397283 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-cda0509c-ecf1-4d44-8c6c-5d0a65745762 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:22.397892 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-cda0509c-ecf1-4d44-8c6c-5d0a65745762 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:22.406600 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cda0509c-ecf1-4d44-8c6c-5d0a65745762 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:22.407088 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cda0509c-ecf1-4d44-8c6c-5d0a65745762 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:22.407530 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cda0509c-ecf1-4d44-8c6c-5d0a65745762 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:22.408221 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cda0509c-ecf1-4d44-8c6c-5d0a65745762 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:22.409264 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cda0509c-ecf1-4d44-8c6c-5d0a65745762 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:22.409697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cda0509c-ecf1-4d44-8c6c-5d0a65745762 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:22.511395 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-88737775-ff7e-41d5-8fe1-c01bffffd1ee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:22.512002 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-88737775-ff7e-41d5-8fe1-c01bffffd1ee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:22.518581 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-88737775-ff7e-41d5-8fe1-c01bffffd1ee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:22.519371 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-88737775-ff7e-41d5-8fe1-c01bffffd1ee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:22.520002 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-88737775-ff7e-41d5-8fe1-c01bffffd1ee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:22.521001 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-88737775-ff7e-41d5-8fe1-c01bffffd1ee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:22.521643 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-88737775-ff7e-41d5-8fe1-c01bffffd1ee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:22.522248 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-88737775-ff7e-41d5-8fe1-c01bffffd1ee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:22.555822 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-cda0509c-ecf1-4d44-8c6c-5d0a65745762 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:22.567234 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-cda0509c-ecf1-4d44-8c6c-5d0a65745762 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 0.173042 Aug 05 20:03:22.568146 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 39/78] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:22 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:22.672998 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-88737775-ff7e-41d5-8fe1-c01bffffd1ee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:22.680790 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-88737775-ff7e-41d5-8fe1-c01bffffd1ee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.173072 Aug 05 20:03:22.681667 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 40/79] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:22 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:23.308880 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-e0066752-6245-4c55-b7ef-34f3ecf9f9d8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:23.309502 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-e0066752-6245-4c55-b7ef-34f3ecf9f9d8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:23.317388 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e0066752-6245-4c55-b7ef-34f3ecf9f9d8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:23.317878 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e0066752-6245-4c55-b7ef-34f3ecf9f9d8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:23.318844 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e0066752-6245-4c55-b7ef-34f3ecf9f9d8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:23.319575 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e0066752-6245-4c55-b7ef-34f3ecf9f9d8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:23.320112 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e0066752-6245-4c55-b7ef-34f3ecf9f9d8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:23.320730 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e0066752-6245-4c55-b7ef-34f3ecf9f9d8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:23.493548 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-e0066752-6245-4c55-b7ef-34f3ecf9f9d8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:23.502895 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-e0066752-6245-4c55-b7ef-34f3ecf9f9d8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.198072 Aug 05 20:03:23.504084 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 40/80] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:23 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:23.600523 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-0d46c400-bef9-4815-9237-8dc35ed16dd4 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:23.601311 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-0d46c400-bef9-4815-9237-8dc35ed16dd4 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:23.611421 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0d46c400-bef9-4815-9237-8dc35ed16dd4 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:23.613403 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0d46c400-bef9-4815-9237-8dc35ed16dd4 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:23.614007 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0d46c400-bef9-4815-9237-8dc35ed16dd4 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:23.615749 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0d46c400-bef9-4815-9237-8dc35ed16dd4 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:23.616816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0d46c400-bef9-4815-9237-8dc35ed16dd4 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:23.617242 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0d46c400-bef9-4815-9237-8dc35ed16dd4 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:23.703881 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-52130c40-c837-407b-b33f-38291ec6214c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:23.706580 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-52130c40-c837-407b-b33f-38291ec6214c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:23.720067 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-52130c40-c837-407b-b33f-38291ec6214c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:23.720941 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-52130c40-c837-407b-b33f-38291ec6214c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:23.722046 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-52130c40-c837-407b-b33f-38291ec6214c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:23.722995 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-52130c40-c837-407b-b33f-38291ec6214c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:23.723779 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-52130c40-c837-407b-b33f-38291ec6214c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:23.724794 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-52130c40-c837-407b-b33f-38291ec6214c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:23.844845 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-0d46c400-bef9-4815-9237-8dc35ed16dd4 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:23.854641 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-0d46c400-bef9-4815-9237-8dc35ed16dd4 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 0.266095 Aug 05 20:03:23.855783 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 41/81] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:23 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:23.923272 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-52130c40-c837-407b-b33f-38291ec6214c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:23.944518 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-52130c40-c837-407b-b33f-38291ec6214c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.244809 Aug 05 20:03:23.947257 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 41/82] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:23 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:24.526329 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-2dd175c6-9ce0-42fb-bbc2-d29e2277e4f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:24.528179 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-2dd175c6-9ce0-42fb-bbc2-d29e2277e4f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:24.536896 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2dd175c6-9ce0-42fb-bbc2-d29e2277e4f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:24.537637 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2dd175c6-9ce0-42fb-bbc2-d29e2277e4f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:24.538417 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2dd175c6-9ce0-42fb-bbc2-d29e2277e4f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:24.539568 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2dd175c6-9ce0-42fb-bbc2-d29e2277e4f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:24.540893 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2dd175c6-9ce0-42fb-bbc2-d29e2277e4f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:24.542083 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2dd175c6-9ce0-42fb-bbc2-d29e2277e4f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:24.571771 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-86390a6e-3395-4439-bda2-fd0a8b2357b2 req-79140c9f-8ff7-4316-a55b-e4808d67df25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaafcd0b-5f14-4973-8cc5-274510846bc2", "name": "network-vif-plugged", "status": "completed", "tag": "ee1754c1-6ea5-469b-8697-519cd9b01157"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:03:24.598354 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-86390a6e-3395-4439-bda2-fd0a8b2357b2 req-79140c9f-8ff7-4316-a55b-e4808d67df25 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:24.598672 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-86390a6e-3395-4439-bda2-fd0a8b2357b2 req-79140c9f-8ff7-4316-a55b-e4808d67df25 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:24.599147 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-86390a6e-3395-4439-bda2-fd0a8b2357b2 req-79140c9f-8ff7-4316-a55b-e4808d67df25 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:24.627597 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-86390a6e-3395-4439-bda2-fd0a8b2357b2 req-79140c9f-8ff7-4316-a55b-e4808d67df25 service nova] Creating event network-vif-plugged:ee1754c1-6ea5-469b-8697-519cd9b01157 for instance eaafcd0b-5f14-4973-8cc5-274510846bc2 on hv-cinder-85221 Aug 05 20:03:24.630732 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-86390a6e-3395-4439-bda2-fd0a8b2357b2 req-79140c9f-8ff7-4316-a55b-e4808d67df25 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118191) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 05 20:03:24.631140 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-86390a6e-3395-4439-bda2-fd0a8b2357b2 req-79140c9f-8ff7-4316-a55b-e4808d67df25 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118191) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 05 20:03:24.635112 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4d843957-25d5-495e-bbbf-e87c97055433 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:24.636075 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4d843957-25d5-495e-bbbf-e87c97055433 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:24.638448 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4d843957-25d5-495e-bbbf-e87c97055433 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:24.640361 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4d843957-25d5-495e-bbbf-e87c97055433 None None] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:24.642191 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4d843957-25d5-495e-bbbf-e87c97055433 None None] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:24.645653 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4d843957-25d5-495e-bbbf-e87c97055433 None None] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:24.663653 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.compute.rpcapi [None req-4d843957-25d5-495e-bbbf-e87c97055433 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 05 20:03:24.667004 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4d843957-25d5-495e-bbbf-e87c97055433 None None] Releasing lock "compute-rpcapi-router" {{(pid=118191) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 05 20:03:24.700710 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-4d843957-25d5-495e-bbbf-e87c97055433 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202009 Aug 05 20:03:24.702351 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 42/83] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:03:24.850990 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-2dd175c6-9ce0-42fb-bbc2-d29e2277e4f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:24.860344 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-2dd175c6-9ce0-42fb-bbc2-d29e2277e4f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.338219 Aug 05 20:03:24.862257 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 42/84] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:24 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:24.877183 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-d8b63346-79e7-47ef-a7fa-91868070c881 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:24.878139 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-d8b63346-79e7-47ef-a7fa-91868070c881 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:24.885729 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d8b63346-79e7-47ef-a7fa-91868070c881 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:24.886422 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d8b63346-79e7-47ef-a7fa-91868070c881 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:24.887075 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d8b63346-79e7-47ef-a7fa-91868070c881 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:24.887782 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d8b63346-79e7-47ef-a7fa-91868070c881 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:24.888241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d8b63346-79e7-47ef-a7fa-91868070c881 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:24.888694 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d8b63346-79e7-47ef-a7fa-91868070c881 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:24.968498 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-3fc1ded5-8619-4c96-9f2b-b103cc284394 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:24.970261 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-3fc1ded5-8619-4c96-9f2b-b103cc284394 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:24.978552 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3fc1ded5-8619-4c96-9f2b-b103cc284394 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:24.979041 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3fc1ded5-8619-4c96-9f2b-b103cc284394 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:24.979468 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3fc1ded5-8619-4c96-9f2b-b103cc284394 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:24.980365 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3fc1ded5-8619-4c96-9f2b-b103cc284394 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:24.980839 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3fc1ded5-8619-4c96-9f2b-b103cc284394 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:24.982154 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3fc1ded5-8619-4c96-9f2b-b103cc284394 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:25.052181 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-d8b63346-79e7-47ef-a7fa-91868070c881 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:25.060628 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-d8b63346-79e7-47ef-a7fa-91868070c881 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 0.188121 Aug 05 20:03:25.061254 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 43/85] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:24 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:25.140872 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-3fc1ded5-8619-4c96-9f2b-b103cc284394 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:25.150683 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-3fc1ded5-8619-4c96-9f2b-b103cc284394 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.186252 Aug 05 20:03:25.156948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 43/86] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:24 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:25.882715 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e6fb63f5-16d4-454a-8984-477f5482ac62 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:25.883359 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e6fb63f5-16d4-454a-8984-477f5482ac62 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:25.889573 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e6fb63f5-16d4-454a-8984-477f5482ac62 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:25.890174 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e6fb63f5-16d4-454a-8984-477f5482ac62 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:25.890606 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e6fb63f5-16d4-454a-8984-477f5482ac62 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:25.891390 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e6fb63f5-16d4-454a-8984-477f5482ac62 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:25.891837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e6fb63f5-16d4-454a-8984-477f5482ac62 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:25.892256 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e6fb63f5-16d4-454a-8984-477f5482ac62 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:26.035892 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e6fb63f5-16d4-454a-8984-477f5482ac62 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:26.043317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e6fb63f5-16d4-454a-8984-477f5482ac62 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.164466 Aug 05 20:03:26.044211 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 44/87] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:25 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:26.085097 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b1111189-a802-4959-b74c-96696787cde9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:26.085852 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-b1111189-a802-4959-b74c-96696787cde9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:26.092091 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b1111189-a802-4959-b74c-96696787cde9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:26.092616 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b1111189-a802-4959-b74c-96696787cde9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:26.093078 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b1111189-a802-4959-b74c-96696787cde9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:26.093812 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b1111189-a802-4959-b74c-96696787cde9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:26.094472 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b1111189-a802-4959-b74c-96696787cde9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:26.094910 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b1111189-a802-4959-b74c-96696787cde9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:26.172249 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-eff09a49-5ab5-4630-a803-09f8686e4357 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:26.172997 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-eff09a49-5ab5-4630-a803-09f8686e4357 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:26.180180 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eff09a49-5ab5-4630-a803-09f8686e4357 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:26.180712 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eff09a49-5ab5-4630-a803-09f8686e4357 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:26.181783 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eff09a49-5ab5-4630-a803-09f8686e4357 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:26.182685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eff09a49-5ab5-4630-a803-09f8686e4357 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:26.183369 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eff09a49-5ab5-4630-a803-09f8686e4357 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:26.183877 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eff09a49-5ab5-4630-a803-09f8686e4357 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:26.267204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-b1111189-a802-4959-b74c-96696787cde9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:26.276401 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b1111189-a802-4959-b74c-96696787cde9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 0.196826 Aug 05 20:03:26.276942 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 44/88] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:26 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:26.332694 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-eff09a49-5ab5-4630-a803-09f8686e4357 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:26.341244 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-eff09a49-5ab5-4630-a803-09f8686e4357 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.173734 Aug 05 20:03:26.342033 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 45/89] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:26 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:27.064941 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-8a821e79-f020-4ca7-bed3-1af31e5fcc6d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:27.065596 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-8a821e79-f020-4ca7-bed3-1af31e5fcc6d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:27.071462 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8a821e79-f020-4ca7-bed3-1af31e5fcc6d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:27.071942 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8a821e79-f020-4ca7-bed3-1af31e5fcc6d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:27.072370 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8a821e79-f020-4ca7-bed3-1af31e5fcc6d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:27.073075 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8a821e79-f020-4ca7-bed3-1af31e5fcc6d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:27.073522 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8a821e79-f020-4ca7-bed3-1af31e5fcc6d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:27.073937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8a821e79-f020-4ca7-bed3-1af31e5fcc6d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:27.207507 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-8a821e79-f020-4ca7-bed3-1af31e5fcc6d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:27.215310 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-8a821e79-f020-4ca7-bed3-1af31e5fcc6d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.154889 Aug 05 20:03:27.215879 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 45/90] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:27 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:27.297871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-5f1cc0d1-1527-43be-9f6b-cc01e977642b tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:27.298471 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-5f1cc0d1-1527-43be-9f6b-cc01e977642b tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:27.304433 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5f1cc0d1-1527-43be-9f6b-cc01e977642b tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:27.304970 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5f1cc0d1-1527-43be-9f6b-cc01e977642b tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:27.305402 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5f1cc0d1-1527-43be-9f6b-cc01e977642b tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:27.306097 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5f1cc0d1-1527-43be-9f6b-cc01e977642b tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:27.306552 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5f1cc0d1-1527-43be-9f6b-cc01e977642b tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:27.306974 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5f1cc0d1-1527-43be-9f6b-cc01e977642b tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:27.309680 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=100 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:03:27.365080 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-50528a30-ac48-4b78-9287-7fa2b90dd038 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:27.365706 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-50528a30-ac48-4b78-9287-7fa2b90dd038 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:27.372818 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-50528a30-ac48-4b78-9287-7fa2b90dd038 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:27.373544 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-50528a30-ac48-4b78-9287-7fa2b90dd038 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:27.374070 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-50528a30-ac48-4b78-9287-7fa2b90dd038 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:27.374890 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-50528a30-ac48-4b78-9287-7fa2b90dd038 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:27.375616 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-50528a30-ac48-4b78-9287-7fa2b90dd038 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:27.376147 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-50528a30-ac48-4b78-9287-7fa2b90dd038 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:27.492561 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-5f1cc0d1-1527-43be-9f6b-cc01e977642b tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:27.500368 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-5f1cc0d1-1527-43be-9f6b-cc01e977642b tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 0.206635 Aug 05 20:03:27.500975 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 46/91] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:27 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:27.539866 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-50528a30-ac48-4b78-9287-7fa2b90dd038 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:27.542155 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=100 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:03:27.549607 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-50528a30-ac48-4b78-9287-7fa2b90dd038 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.187758 Aug 05 20:03:27.550838 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 46/92] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:27 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:28.236702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a59d50e4-3790-4424-a48e-d3eb36dbb1d7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:28.237317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-a59d50e4-3790-4424-a48e-d3eb36dbb1d7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:28.243211 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a59d50e4-3790-4424-a48e-d3eb36dbb1d7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:28.243699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a59d50e4-3790-4424-a48e-d3eb36dbb1d7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:28.244135 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a59d50e4-3790-4424-a48e-d3eb36dbb1d7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:28.244863 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a59d50e4-3790-4424-a48e-d3eb36dbb1d7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:28.245318 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a59d50e4-3790-4424-a48e-d3eb36dbb1d7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:28.245749 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a59d50e4-3790-4424-a48e-d3eb36dbb1d7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:28.523881 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-5a3a896c-8b0c-4693-b1cb-a52494dc5f4a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:28.524691 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-5a3a896c-8b0c-4693-b1cb-a52494dc5f4a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:28.530940 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5a3a896c-8b0c-4693-b1cb-a52494dc5f4a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:28.531505 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5a3a896c-8b0c-4693-b1cb-a52494dc5f4a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:28.532017 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5a3a896c-8b0c-4693-b1cb-a52494dc5f4a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:28.532834 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5a3a896c-8b0c-4693-b1cb-a52494dc5f4a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:28.533363 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5a3a896c-8b0c-4693-b1cb-a52494dc5f4a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:28.533955 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5a3a896c-8b0c-4693-b1cb-a52494dc5f4a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:28.555923 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a59d50e4-3790-4424-a48e-d3eb36dbb1d7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:28.563241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-a59d50e4-3790-4424-a48e-d3eb36dbb1d7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.330479 Aug 05 20:03:28.563803 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 47/93] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:28 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:28.571511 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-d46fb9ef-3163-4ab1-a7ea-bf3af836ab27 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:28.572127 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-d46fb9ef-3163-4ab1-a7ea-bf3af836ab27 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:28.578706 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d46fb9ef-3163-4ab1-a7ea-bf3af836ab27 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:28.579203 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d46fb9ef-3163-4ab1-a7ea-bf3af836ab27 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:28.579638 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d46fb9ef-3163-4ab1-a7ea-bf3af836ab27 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:28.581121 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d46fb9ef-3163-4ab1-a7ea-bf3af836ab27 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:28.581759 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d46fb9ef-3163-4ab1-a7ea-bf3af836ab27 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:28.582192 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d46fb9ef-3163-4ab1-a7ea-bf3af836ab27 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:28.718094 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-5a3a896c-8b0c-4693-b1cb-a52494dc5f4a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:28.736096 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-5a3a896c-8b0c-4693-b1cb-a52494dc5f4a tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 0.214093 Aug 05 20:03:28.736783 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 47/94] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:28 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:28.770901 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-d46fb9ef-3163-4ab1-a7ea-bf3af836ab27 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:28.782616 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-d46fb9ef-3163-4ab1-a7ea-bf3af836ab27 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.214183 Aug 05 20:03:28.783365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 48/95] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:28 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:29.584999 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-1a9d551a-60a9-425b-ab34-9e496049182a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:29.585602 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-1a9d551a-60a9-425b-ab34-9e496049182a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:29.591403 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1a9d551a-60a9-425b-ab34-9e496049182a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:29.591879 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1a9d551a-60a9-425b-ab34-9e496049182a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:29.592304 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1a9d551a-60a9-425b-ab34-9e496049182a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:29.593013 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1a9d551a-60a9-425b-ab34-9e496049182a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:29.593458 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1a9d551a-60a9-425b-ab34-9e496049182a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:29.593876 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1a9d551a-60a9-425b-ab34-9e496049182a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:29.743971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-1a9d551a-60a9-425b-ab34-9e496049182a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:29.751416 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-1a9d551a-60a9-425b-ab34-9e496049182a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.170147 Aug 05 20:03:29.751906 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 48/96] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:29 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:29.756555 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-36bd3163-e837-4906-8ac5-3b02fab3811c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:29.757203 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-36bd3163-e837-4906-8ac5-3b02fab3811c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:29.763513 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-36bd3163-e837-4906-8ac5-3b02fab3811c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:29.763997 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-36bd3163-e837-4906-8ac5-3b02fab3811c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:29.764507 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-36bd3163-e837-4906-8ac5-3b02fab3811c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:29.765227 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-36bd3163-e837-4906-8ac5-3b02fab3811c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:29.765675 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-36bd3163-e837-4906-8ac5-3b02fab3811c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:29.766095 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-36bd3163-e837-4906-8ac5-3b02fab3811c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:29.804960 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-41b1af1a-df90-461c-8e95-b535ebc699d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:29.806097 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-41b1af1a-df90-461c-8e95-b535ebc699d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:29.812457 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-41b1af1a-df90-461c-8e95-b535ebc699d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:29.813271 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-41b1af1a-df90-461c-8e95-b535ebc699d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:29.813906 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-41b1af1a-df90-461c-8e95-b535ebc699d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:29.816239 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-41b1af1a-df90-461c-8e95-b535ebc699d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:29.816764 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-41b1af1a-df90-461c-8e95-b535ebc699d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:29.817199 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-41b1af1a-df90-461c-8e95-b535ebc699d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:29.945867 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-36bd3163-e837-4906-8ac5-3b02fab3811c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:29.953830 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-36bd3163-e837-4906-8ac5-3b02fab3811c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 0.201350 Aug 05 20:03:29.956747 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 49/97] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:29 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:29.991835 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-41b1af1a-df90-461c-8e95-b535ebc699d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:29.999232 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-41b1af1a-df90-461c-8e95-b535ebc699d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.198374 Aug 05 20:03:29.999800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 49/98] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:29 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:30.772962 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-92dd38df-d01b-4a0c-817f-1812a9580dd8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:30.774553 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-92dd38df-d01b-4a0c-817f-1812a9580dd8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:30.784304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-92dd38df-d01b-4a0c-817f-1812a9580dd8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:30.785092 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-92dd38df-d01b-4a0c-817f-1812a9580dd8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:30.785765 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-92dd38df-d01b-4a0c-817f-1812a9580dd8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:30.786721 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-92dd38df-d01b-4a0c-817f-1812a9580dd8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:30.787586 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-92dd38df-d01b-4a0c-817f-1812a9580dd8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:30.788021 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-92dd38df-d01b-4a0c-817f-1812a9580dd8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:30.951232 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-92dd38df-d01b-4a0c-817f-1812a9580dd8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:30.964201 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-92dd38df-d01b-4a0c-817f-1812a9580dd8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.196337 Aug 05 20:03:30.964887 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 50/99] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:30 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:30.977969 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-3632aed8-2886-42d8-9d18-323b2f2c49f5 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:30.978580 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-3632aed8-2886-42d8-9d18-323b2f2c49f5 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:30.984381 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3632aed8-2886-42d8-9d18-323b2f2c49f5 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:30.984914 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3632aed8-2886-42d8-9d18-323b2f2c49f5 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:30.985344 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3632aed8-2886-42d8-9d18-323b2f2c49f5 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:30.986600 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3632aed8-2886-42d8-9d18-323b2f2c49f5 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:30.987293 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3632aed8-2886-42d8-9d18-323b2f2c49f5 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:30.988097 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3632aed8-2886-42d8-9d18-323b2f2c49f5 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:31.022945 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-81ffafe3-bfd0-4ad1-bbc6-38b61aee93e2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:31.024053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-81ffafe3-bfd0-4ad1-bbc6-38b61aee93e2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:31.035942 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-81ffafe3-bfd0-4ad1-bbc6-38b61aee93e2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:31.036709 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-81ffafe3-bfd0-4ad1-bbc6-38b61aee93e2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:31.037374 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-81ffafe3-bfd0-4ad1-bbc6-38b61aee93e2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:31.038353 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-81ffafe3-bfd0-4ad1-bbc6-38b61aee93e2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:31.039276 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-81ffafe3-bfd0-4ad1-bbc6-38b61aee93e2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:31.040237 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-81ffafe3-bfd0-4ad1-bbc6-38b61aee93e2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:31.228384 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-3632aed8-2886-42d8-9d18-323b2f2c49f5 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:31.241007 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-3632aed8-2886-42d8-9d18-323b2f2c49f5 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 0.266573 Aug 05 20:03:31.246258 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 50/100] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:30 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:31.256844 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-81ffafe3-bfd0-4ad1-bbc6-38b61aee93e2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:31.264112 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-81ffafe3-bfd0-4ad1-bbc6-38b61aee93e2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.248027 Aug 05 20:03:31.264957 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 51/101] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:31 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:31.985320 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-0479b0e8-8c29-4225-bd36-ab174992400f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:31.985937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-0479b0e8-8c29-4225-bd36-ab174992400f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:31.991849 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0479b0e8-8c29-4225-bd36-ab174992400f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:31.992337 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0479b0e8-8c29-4225-bd36-ab174992400f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:31.992810 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0479b0e8-8c29-4225-bd36-ab174992400f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:31.993501 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0479b0e8-8c29-4225-bd36-ab174992400f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:31.993956 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0479b0e8-8c29-4225-bd36-ab174992400f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:31.994384 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0479b0e8-8c29-4225-bd36-ab174992400f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:32.128506 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-0479b0e8-8c29-4225-bd36-ab174992400f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:32.136221 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-0479b0e8-8c29-4225-bd36-ab174992400f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.154785 Aug 05 20:03:32.136824 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 51/102] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:31 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:32.262352 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-bfcbfa6f-250a-454a-a07f-483a454aa4e2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:32.262960 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-bfcbfa6f-250a-454a-a07f-483a454aa4e2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:32.269710 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bfcbfa6f-250a-454a-a07f-483a454aa4e2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:32.270474 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bfcbfa6f-250a-454a-a07f-483a454aa4e2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:32.270903 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bfcbfa6f-250a-454a-a07f-483a454aa4e2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:32.271586 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bfcbfa6f-250a-454a-a07f-483a454aa4e2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:32.272034 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bfcbfa6f-250a-454a-a07f-483a454aa4e2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:32.272458 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bfcbfa6f-250a-454a-a07f-483a454aa4e2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:32.284809 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-3c2103cb-5e23-4b33-9430-d434a3ffd807 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:32.285423 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-3c2103cb-5e23-4b33-9430-d434a3ffd807 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:32.291326 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3c2103cb-5e23-4b33-9430-d434a3ffd807 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:32.291809 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3c2103cb-5e23-4b33-9430-d434a3ffd807 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:32.292243 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3c2103cb-5e23-4b33-9430-d434a3ffd807 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:32.292963 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3c2103cb-5e23-4b33-9430-d434a3ffd807 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:32.293412 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3c2103cb-5e23-4b33-9430-d434a3ffd807 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:32.293832 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3c2103cb-5e23-4b33-9430-d434a3ffd807 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:32.464943 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-bfcbfa6f-250a-454a-a07f-483a454aa4e2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:32.472698 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-bfcbfa6f-250a-454a-a07f-483a454aa4e2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 0.214110 Aug 05 20:03:32.476662 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 52/103] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:32 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:32.477020 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-3c2103cb-5e23-4b33-9430-d434a3ffd807 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:32.483474 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-3c2103cb-5e23-4b33-9430-d434a3ffd807 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.202722 Aug 05 20:03:32.484110 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 52/104] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:32 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:33.164120 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9367d0e3-32ff-488c-a638-5386550fa24f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:33.164779 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-9367d0e3-32ff-488c-a638-5386550fa24f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:33.170733 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9367d0e3-32ff-488c-a638-5386550fa24f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:33.171242 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9367d0e3-32ff-488c-a638-5386550fa24f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:33.171673 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9367d0e3-32ff-488c-a638-5386550fa24f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:33.172358 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9367d0e3-32ff-488c-a638-5386550fa24f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:33.172828 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9367d0e3-32ff-488c-a638-5386550fa24f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:33.173249 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9367d0e3-32ff-488c-a638-5386550fa24f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:33.303562 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9367d0e3-32ff-488c-a638-5386550fa24f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:33.311080 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-9367d0e3-32ff-488c-a638-5386550fa24f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.150665 Aug 05 20:03:33.311564 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 53/105] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:33 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:33.494256 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-532285e9-8ee6-49a7-a7f5-46f64edf5fe5 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:33.494864 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-532285e9-8ee6-49a7-a7f5-46f64edf5fe5 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:33.500773 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-532285e9-8ee6-49a7-a7f5-46f64edf5fe5 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:33.501255 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-532285e9-8ee6-49a7-a7f5-46f64edf5fe5 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:33.502205 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-532285e9-8ee6-49a7-a7f5-46f64edf5fe5 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:33.503153 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-532285e9-8ee6-49a7-a7f5-46f64edf5fe5 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:33.503602 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-532285e9-8ee6-49a7-a7f5-46f64edf5fe5 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:33.504022 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-532285e9-8ee6-49a7-a7f5-46f64edf5fe5 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:33.505092 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-27f0b41d-4e4c-4e2e-b888-04286910da2e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:33.505761 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-27f0b41d-4e4c-4e2e-b888-04286910da2e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:33.511515 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-27f0b41d-4e4c-4e2e-b888-04286910da2e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:33.512003 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-27f0b41d-4e4c-4e2e-b888-04286910da2e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:33.512439 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-27f0b41d-4e4c-4e2e-b888-04286910da2e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:33.513168 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-27f0b41d-4e4c-4e2e-b888-04286910da2e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:33.513624 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-27f0b41d-4e4c-4e2e-b888-04286910da2e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:33.514059 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-27f0b41d-4e4c-4e2e-b888-04286910da2e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:33.700549 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-532285e9-8ee6-49a7-a7f5-46f64edf5fe5 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:33.703847 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-27f0b41d-4e4c-4e2e-b888-04286910da2e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:33.708349 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-532285e9-8ee6-49a7-a7f5-46f64edf5fe5 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 0.217938 Aug 05 20:03:33.709038 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 53/106] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:33 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:33.711477 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-27f0b41d-4e4c-4e2e-b888-04286910da2e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.210746 Aug 05 20:03:33.712038 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 54/107] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:33 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:34.331707 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-e40e5d34-d026-4dee-b0bf-cee1e646385d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:34.332359 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-e40e5d34-d026-4dee-b0bf-cee1e646385d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:34.338345 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e40e5d34-d026-4dee-b0bf-cee1e646385d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:34.338828 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e40e5d34-d026-4dee-b0bf-cee1e646385d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:34.339260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e40e5d34-d026-4dee-b0bf-cee1e646385d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:34.339944 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e40e5d34-d026-4dee-b0bf-cee1e646385d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:34.340399 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e40e5d34-d026-4dee-b0bf-cee1e646385d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:34.340855 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e40e5d34-d026-4dee-b0bf-cee1e646385d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:34.472951 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-e40e5d34-d026-4dee-b0bf-cee1e646385d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:34.480397 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-e40e5d34-d026-4dee-b0bf-cee1e646385d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.153072 Aug 05 20:03:34.481010 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 54/108] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:34 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:34.729878 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-61fd649d-f6ff-4ea3-8097-71ae257b36b8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:34.730499 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-61fd649d-f6ff-4ea3-8097-71ae257b36b8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:34.731648 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-0e514ac7-2ed4-4c81-8623-bd40c8895fab tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:34.732283 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-0e514ac7-2ed4-4c81-8623-bd40c8895fab tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:34.732431 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=2 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:03:34.738006 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-61fd649d-f6ff-4ea3-8097-71ae257b36b8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:34.738496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-61fd649d-f6ff-4ea3-8097-71ae257b36b8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:34.738937 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-61fd649d-f6ff-4ea3-8097-71ae257b36b8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:34.739047 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0e514ac7-2ed4-4c81-8623-bd40c8895fab tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:34.739522 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0e514ac7-2ed4-4c81-8623-bd40c8895fab tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:34.739628 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-61fd649d-f6ff-4ea3-8097-71ae257b36b8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:34.740074 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-61fd649d-f6ff-4ea3-8097-71ae257b36b8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:34.740179 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0e514ac7-2ed4-4c81-8623-bd40c8895fab tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:34.740501 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-61fd649d-f6ff-4ea3-8097-71ae257b36b8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:34.740880 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0e514ac7-2ed4-4c81-8623-bd40c8895fab tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:34.741553 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0e514ac7-2ed4-4c81-8623-bd40c8895fab tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:34.742074 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0e514ac7-2ed4-4c81-8623-bd40c8895fab tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:34.933312 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-61fd649d-f6ff-4ea3-8097-71ae257b36b8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:34.940773 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-61fd649d-f6ff-4ea3-8097-71ae257b36b8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 0.214618 Aug 05 20:03:34.940926 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-0e514ac7-2ed4-4c81-8623-bd40c8895fab tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:34.941343 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 55/109] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:34 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:34.948096 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-0e514ac7-2ed4-4c81-8623-bd40c8895fab tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.220277 Aug 05 20:03:34.948673 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 55/110] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:34 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:35.501644 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-bd863c53-17e4-4747-8911-5328989069ec tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:35.502275 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-bd863c53-17e4-4747-8911-5328989069ec tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:35.508157 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bd863c53-17e4-4747-8911-5328989069ec tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:35.508677 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bd863c53-17e4-4747-8911-5328989069ec tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:35.509114 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bd863c53-17e4-4747-8911-5328989069ec tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:35.509804 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bd863c53-17e4-4747-8911-5328989069ec tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:35.510259 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bd863c53-17e4-4747-8911-5328989069ec tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:35.510687 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bd863c53-17e4-4747-8911-5328989069ec tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:35.643206 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-bd863c53-17e4-4747-8911-5328989069ec tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:35.651417 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-bd863c53-17e4-4747-8911-5328989069ec tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.153566 Aug 05 20:03:35.651932 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 56/111] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:35 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:35.962477 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ae0d1d32-c336-4934-9a11-e01154e058e2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:35.963156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-ae0d1d32-c336-4934-9a11-e01154e058e2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:35.968997 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-076a5bf4-1674-4b9f-baee-eade4b6717aa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:35.969515 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ae0d1d32-c336-4934-9a11-e01154e058e2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:35.969846 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ae0d1d32-c336-4934-9a11-e01154e058e2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:35.969958 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-076a5bf4-1674-4b9f-baee-eade4b6717aa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:35.970327 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ae0d1d32-c336-4934-9a11-e01154e058e2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:35.971075 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ae0d1d32-c336-4934-9a11-e01154e058e2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:35.971578 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ae0d1d32-c336-4934-9a11-e01154e058e2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:35.972005 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ae0d1d32-c336-4934-9a11-e01154e058e2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:35.977480 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-076a5bf4-1674-4b9f-baee-eade4b6717aa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:35.977480 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-076a5bf4-1674-4b9f-baee-eade4b6717aa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:35.977480 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-076a5bf4-1674-4b9f-baee-eade4b6717aa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:35.977879 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-076a5bf4-1674-4b9f-baee-eade4b6717aa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:35.978388 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-076a5bf4-1674-4b9f-baee-eade4b6717aa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:35.978817 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-076a5bf4-1674-4b9f-baee-eade4b6717aa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:36.168761 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-076a5bf4-1674-4b9f-baee-eade4b6717aa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:36.179734 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-076a5bf4-1674-4b9f-baee-eade4b6717aa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.214693 Aug 05 20:03:36.180773 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 57/112] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:35 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:36.183376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-ae0d1d32-c336-4934-9a11-e01154e058e2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:36.185387 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-5a3c1e9a-0afc-42ef-8bb2-930a8c08c751 req-18548f6c-ab93-44bb-8f59-9f34586a3e34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03228f62-79c6-41a8-9f85-256350c24645", "name": "network-vif-plugged", "status": "completed", "tag": "232c6be7-dcbd-4144-841f-4ab31b81702b"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:03:36.191060 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-ae0d1d32-c336-4934-9a11-e01154e058e2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 0.232554 Aug 05 20:03:36.191997 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 56/113] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:35 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:36.197393 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-5a3c1e9a-0afc-42ef-8bb2-930a8c08c751 req-18548f6c-ab93-44bb-8f59-9f34586a3e34 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:36.197870 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-5a3c1e9a-0afc-42ef-8bb2-930a8c08c751 req-18548f6c-ab93-44bb-8f59-9f34586a3e34 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:36.198298 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-5a3c1e9a-0afc-42ef-8bb2-930a8c08c751 req-18548f6c-ab93-44bb-8f59-9f34586a3e34 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:36.210222 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-5a3c1e9a-0afc-42ef-8bb2-930a8c08c751 req-18548f6c-ab93-44bb-8f59-9f34586a3e34 service nova] Creating event network-vif-plugged:232c6be7-dcbd-4144-841f-4ab31b81702b for instance 03228f62-79c6-41a8-9f85-256350c24645 on hv-cinder-85221 Aug 05 20:03:36.215232 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-5a3c1e9a-0afc-42ef-8bb2-930a8c08c751 req-18548f6c-ab93-44bb-8f59-9f34586a3e34 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033590 Aug 05 20:03:36.215821 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 58/114] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:03:36.673085 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-09465efd-8444-486f-8be9-cde857789927 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:36.673800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-09465efd-8444-486f-8be9-cde857789927 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:36.679918 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-09465efd-8444-486f-8be9-cde857789927 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:36.680336 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-09465efd-8444-486f-8be9-cde857789927 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:36.680802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-09465efd-8444-486f-8be9-cde857789927 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:36.681500 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-09465efd-8444-486f-8be9-cde857789927 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:36.681951 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-09465efd-8444-486f-8be9-cde857789927 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:36.682401 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-09465efd-8444-486f-8be9-cde857789927 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:36.823281 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-09465efd-8444-486f-8be9-cde857789927 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:36.831386 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-09465efd-8444-486f-8be9-cde857789927 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.162217 Aug 05 20:03:36.831938 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 57/115] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:36 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:37.201226 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9206bb32-ef92-4329-8b8f-734a10f43738 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:37.201851 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-9206bb32-ef92-4329-8b8f-734a10f43738 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:37.208568 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9206bb32-ef92-4329-8b8f-734a10f43738 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:37.209089 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9206bb32-ef92-4329-8b8f-734a10f43738 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:37.209528 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9206bb32-ef92-4329-8b8f-734a10f43738 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:37.210226 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9206bb32-ef92-4329-8b8f-734a10f43738 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:37.210704 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9206bb32-ef92-4329-8b8f-734a10f43738 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:37.211144 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9206bb32-ef92-4329-8b8f-734a10f43738 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:37.211271 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a99c221c-5554-4cfa-97e2-ecf51873ad0c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:37.211780 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a99c221c-5554-4cfa-97e2-ecf51873ad0c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:37.217731 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a99c221c-5554-4cfa-97e2-ecf51873ad0c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:37.218207 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a99c221c-5554-4cfa-97e2-ecf51873ad0c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:37.218634 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a99c221c-5554-4cfa-97e2-ecf51873ad0c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:37.219311 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a99c221c-5554-4cfa-97e2-ecf51873ad0c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:37.219756 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a99c221c-5554-4cfa-97e2-ecf51873ad0c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:37.220792 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a99c221c-5554-4cfa-97e2-ecf51873ad0c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:37.418743 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9206bb32-ef92-4329-8b8f-734a10f43738 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:37.422962 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a99c221c-5554-4cfa-97e2-ecf51873ad0c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:37.428019 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-9206bb32-ef92-4329-8b8f-734a10f43738 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.231086 Aug 05 20:03:37.428632 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 59/116] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:37 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:37.432515 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a99c221c-5554-4cfa-97e2-ecf51873ad0c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 0.225176 Aug 05 20:03:37.433107 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 58/117] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:37 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:37.852769 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-ff5203ec-b9cc-40e3-9d59-64dcdf8496c4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:37.853744 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-ff5203ec-b9cc-40e3-9d59-64dcdf8496c4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:37.861239 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ff5203ec-b9cc-40e3-9d59-64dcdf8496c4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:37.862262 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ff5203ec-b9cc-40e3-9d59-64dcdf8496c4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:37.862751 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ff5203ec-b9cc-40e3-9d59-64dcdf8496c4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:37.863453 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ff5203ec-b9cc-40e3-9d59-64dcdf8496c4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:37.863906 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ff5203ec-b9cc-40e3-9d59-64dcdf8496c4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:37.864331 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ff5203ec-b9cc-40e3-9d59-64dcdf8496c4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:38.054993 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-ff5203ec-b9cc-40e3-9d59-64dcdf8496c4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:38.067651 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-ff5203ec-b9cc-40e3-9d59-64dcdf8496c4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.218511 Aug 05 20:03:38.068317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 60/118] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:37 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:38.449239 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-dc9d4889-f020-4387-8a2c-aba0481dca1c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:38.449908 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-dc9d4889-f020-4387-8a2c-aba0481dca1c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:38.456080 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-49dae572-aefe-4348-bde1-d439af725866 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:38.456811 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-49dae572-aefe-4348-bde1-d439af725866 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:38.456954 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dc9d4889-f020-4387-8a2c-aba0481dca1c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:38.457381 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dc9d4889-f020-4387-8a2c-aba0481dca1c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:38.457875 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dc9d4889-f020-4387-8a2c-aba0481dca1c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:38.458665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dc9d4889-f020-4387-8a2c-aba0481dca1c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:38.459219 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dc9d4889-f020-4387-8a2c-aba0481dca1c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:38.459826 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dc9d4889-f020-4387-8a2c-aba0481dca1c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:38.464371 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-49dae572-aefe-4348-bde1-d439af725866 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:38.465110 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-49dae572-aefe-4348-bde1-d439af725866 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:38.466198 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-49dae572-aefe-4348-bde1-d439af725866 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:38.467112 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-49dae572-aefe-4348-bde1-d439af725866 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:38.467568 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-49dae572-aefe-4348-bde1-d439af725866 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:38.468195 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-49dae572-aefe-4348-bde1-d439af725866 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:38.670015 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-dc9d4889-f020-4387-8a2c-aba0481dca1c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:38.672771 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-49dae572-aefe-4348-bde1-d439af725866 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:38.678789 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-dc9d4889-f020-4387-8a2c-aba0481dca1c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.233609 Aug 05 20:03:38.679377 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 59/119] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:38 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:38.682805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-49dae572-aefe-4348-bde1-d439af725866 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 0.231450 Aug 05 20:03:38.684004 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 61/120] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:38 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:39.089724 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-f3451203-8dd1-4daa-90c9-82e7fffc83d8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:39.090568 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-f3451203-8dd1-4daa-90c9-82e7fffc83d8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:39.097285 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f3451203-8dd1-4daa-90c9-82e7fffc83d8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:39.097954 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f3451203-8dd1-4daa-90c9-82e7fffc83d8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:39.098413 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f3451203-8dd1-4daa-90c9-82e7fffc83d8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:39.099073 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f3451203-8dd1-4daa-90c9-82e7fffc83d8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:39.099524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f3451203-8dd1-4daa-90c9-82e7fffc83d8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:39.099942 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f3451203-8dd1-4daa-90c9-82e7fffc83d8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:39.249923 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-f3451203-8dd1-4daa-90c9-82e7fffc83d8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:39.259541 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-f3451203-8dd1-4daa-90c9-82e7fffc83d8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.173472 Aug 05 20:03:39.260128 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 60/121] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:39 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:39.360056 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-1365b02d-b6da-471c-9f1c-490e12b21315 req-c8b81160-de57-4220-9659-349fe2796124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d", "name": "network-vif-plugged", "status": "completed", "tag": "d0ef51ee-a75a-482b-8bfb-3cb689fe05cd"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:03:39.371722 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-1365b02d-b6da-471c-9f1c-490e12b21315 req-c8b81160-de57-4220-9659-349fe2796124 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:39.372295 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-1365b02d-b6da-471c-9f1c-490e12b21315 req-c8b81160-de57-4220-9659-349fe2796124 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:39.372703 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-1365b02d-b6da-471c-9f1c-490e12b21315 req-c8b81160-de57-4220-9659-349fe2796124 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:39.385027 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-1365b02d-b6da-471c-9f1c-490e12b21315 req-c8b81160-de57-4220-9659-349fe2796124 service nova] Creating event network-vif-plugged:d0ef51ee-a75a-482b-8bfb-3cb689fe05cd for instance c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d on hv-cinder-85221 Aug 05 20:03:39.390626 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-1365b02d-b6da-471c-9f1c-490e12b21315 req-c8b81160-de57-4220-9659-349fe2796124 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034773 Aug 05 20:03:39.391250 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 62/122] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:03:39.701160 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-02ca6abe-c2e5-411a-9fd1-ff421edc7548 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:39.701777 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-02ca6abe-c2e5-411a-9fd1-ff421edc7548 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:39.706353 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9f9b1319-53d5-43f6-959c-7d222890f4b3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:39.707561 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-9f9b1319-53d5-43f6-959c-7d222890f4b3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:39.712206 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-02ca6abe-c2e5-411a-9fd1-ff421edc7548 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:39.713121 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-02ca6abe-c2e5-411a-9fd1-ff421edc7548 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:39.713564 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-02ca6abe-c2e5-411a-9fd1-ff421edc7548 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:39.714173 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9f9b1319-53d5-43f6-959c-7d222890f4b3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:39.714294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-02ca6abe-c2e5-411a-9fd1-ff421edc7548 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:39.715093 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9f9b1319-53d5-43f6-959c-7d222890f4b3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:39.715185 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9f9b1319-53d5-43f6-959c-7d222890f4b3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:39.715257 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-02ca6abe-c2e5-411a-9fd1-ff421edc7548 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:39.715857 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-02ca6abe-c2e5-411a-9fd1-ff421edc7548 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:39.715967 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9f9b1319-53d5-43f6-959c-7d222890f4b3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:39.716303 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9f9b1319-53d5-43f6-959c-7d222890f4b3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:39.717104 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9f9b1319-53d5-43f6-959c-7d222890f4b3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:39.935946 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-02ca6abe-c2e5-411a-9fd1-ff421edc7548 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:39.944072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-02ca6abe-c2e5-411a-9fd1-ff421edc7548 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.246838 Aug 05 20:03:39.944970 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 61/123] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:39 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:39.963645 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9f9b1319-53d5-43f6-959c-7d222890f4b3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:39.972082 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-9f9b1319-53d5-43f6-959c-7d222890f4b3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 0.270871 Aug 05 20:03:39.972689 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 63/124] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:39 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:40.292790 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-f4bf01fb-1a20-4438-ac15-4fe626278afc tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:40.293701 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-f4bf01fb-1a20-4438-ac15-4fe626278afc tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:40.301376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f4bf01fb-1a20-4438-ac15-4fe626278afc tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:40.302176 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f4bf01fb-1a20-4438-ac15-4fe626278afc tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:40.302820 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f4bf01fb-1a20-4438-ac15-4fe626278afc tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:40.304009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f4bf01fb-1a20-4438-ac15-4fe626278afc tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:40.304693 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f4bf01fb-1a20-4438-ac15-4fe626278afc tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:40.305318 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f4bf01fb-1a20-4438-ac15-4fe626278afc tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:40.538174 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-f4bf01fb-1a20-4438-ac15-4fe626278afc tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:40.546329 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-f4bf01fb-1a20-4438-ac15-4fe626278afc tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.267538 Aug 05 20:03:40.548818 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 62/125] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:40 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:40.965848 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-1a980108-cebf-47e9-bb74-ee81269a25da tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:40.966493 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-1a980108-cebf-47e9-bb74-ee81269a25da tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:40.974383 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1a980108-cebf-47e9-bb74-ee81269a25da tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:40.975127 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1a980108-cebf-47e9-bb74-ee81269a25da tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:40.975617 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1a980108-cebf-47e9-bb74-ee81269a25da tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:40.976430 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1a980108-cebf-47e9-bb74-ee81269a25da tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:40.977264 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1a980108-cebf-47e9-bb74-ee81269a25da tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:40.978069 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1a980108-cebf-47e9-bb74-ee81269a25da tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:40.985135 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=100 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:03:40.995786 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a42d83ef-6515-4fa2-9012-853dab219a63 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:40.997531 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a42d83ef-6515-4fa2-9012-853dab219a63 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:41.004899 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a42d83ef-6515-4fa2-9012-853dab219a63 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:41.006240 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a42d83ef-6515-4fa2-9012-853dab219a63 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:41.006877 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a42d83ef-6515-4fa2-9012-853dab219a63 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:41.007966 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a42d83ef-6515-4fa2-9012-853dab219a63 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:41.008685 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a42d83ef-6515-4fa2-9012-853dab219a63 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:41.009341 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a42d83ef-6515-4fa2-9012-853dab219a63 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:41.042477 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=100 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:03:41.221192 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-1a980108-cebf-47e9-bb74-ee81269a25da tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:41.225993 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a42d83ef-6515-4fa2-9012-853dab219a63 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:41.228685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-1a980108-cebf-47e9-bb74-ee81269a25da tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.266868 Aug 05 20:03:41.229255 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 64/126] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:40 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:41.234235 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a42d83ef-6515-4fa2-9012-853dab219a63 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1315 microversion: 2.1 time: 0.242985 Aug 05 20:03:41.234791 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 63/127] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:40 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:41.570195 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-89873c89-188a-4598-9006-3daaffab0b8a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:41.571040 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-89873c89-188a-4598-9006-3daaffab0b8a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:41.580587 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-89873c89-188a-4598-9006-3daaffab0b8a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:41.581215 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-89873c89-188a-4598-9006-3daaffab0b8a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:41.582250 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-89873c89-188a-4598-9006-3daaffab0b8a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:41.583299 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-89873c89-188a-4598-9006-3daaffab0b8a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:41.583874 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-89873c89-188a-4598-9006-3daaffab0b8a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:41.584452 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-89873c89-188a-4598-9006-3daaffab0b8a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:41.681871 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-e95112f9-96ff-4c62-bae0-16734a6c131a req-fef69e4f-d919-4356-9866-d5955ce7e29c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24ea172c-d11f-41e4-80d8-3f3e5f67cf90", "name": "network-vif-plugged", "status": "completed", "tag": "9d6aae7f-84e8-487b-8606-59afea4d7fad"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:03:41.693808 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-e95112f9-96ff-4c62-bae0-16734a6c131a req-fef69e4f-d919-4356-9866-d5955ce7e29c service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:41.694531 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-e95112f9-96ff-4c62-bae0-16734a6c131a req-fef69e4f-d919-4356-9866-d5955ce7e29c service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:41.695427 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-e95112f9-96ff-4c62-bae0-16734a6c131a req-fef69e4f-d919-4356-9866-d5955ce7e29c service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:41.710195 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-e95112f9-96ff-4c62-bae0-16734a6c131a req-fef69e4f-d919-4356-9866-d5955ce7e29c service nova] Creating event network-vif-plugged:9d6aae7f-84e8-487b-8606-59afea4d7fad for instance 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 on hv-cinder-85221 Aug 05 20:03:41.717787 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-e95112f9-96ff-4c62-bae0-16734a6c131a req-fef69e4f-d919-4356-9866-d5955ce7e29c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039382 Aug 05 20:03:41.718882 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 64/128] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:03:41.794788 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-89873c89-188a-4598-9006-3daaffab0b8a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:41.804195 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-89873c89-188a-4598-9006-3daaffab0b8a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.239946 Aug 05 20:03:41.815217 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 65/129] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:41 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:42.257171 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-0847cdd8-4bf8-4184-b4c3-9c59fe825dae tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:42.257816 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-64f9ff7e-e1e7-484b-bc18-bb9cc1722ecc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:42.258154 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-0847cdd8-4bf8-4184-b4c3-9c59fe825dae tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:42.258242 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-64f9ff7e-e1e7-484b-bc18-bb9cc1722ecc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:42.263798 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0847cdd8-4bf8-4184-b4c3-9c59fe825dae tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:42.264286 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0847cdd8-4bf8-4184-b4c3-9c59fe825dae tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:42.264745 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0847cdd8-4bf8-4184-b4c3-9c59fe825dae tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:42.265224 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-64f9ff7e-e1e7-484b-bc18-bb9cc1722ecc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:42.265440 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0847cdd8-4bf8-4184-b4c3-9c59fe825dae tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:42.265935 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0847cdd8-4bf8-4184-b4c3-9c59fe825dae tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:42.266365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0847cdd8-4bf8-4184-b4c3-9c59fe825dae tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:42.266478 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-64f9ff7e-e1e7-484b-bc18-bb9cc1722ecc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:42.267505 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-64f9ff7e-e1e7-484b-bc18-bb9cc1722ecc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:42.269640 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-64f9ff7e-e1e7-484b-bc18-bb9cc1722ecc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:42.270295 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-64f9ff7e-e1e7-484b-bc18-bb9cc1722ecc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:42.272558 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-64f9ff7e-e1e7-484b-bc18-bb9cc1722ecc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:42.474402 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-0847cdd8-4bf8-4184-b4c3-9c59fe825dae tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:42.478196 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-64f9ff7e-e1e7-484b-bc18-bb9cc1722ecc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:42.482831 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-0847cdd8-4bf8-4184-b4c3-9c59fe825dae tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1502 microversion: 2.1 time: 0.229497 Aug 05 20:03:42.483392 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 66/130] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:42 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1502 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:42.487589 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-64f9ff7e-e1e7-484b-bc18-bb9cc1722ecc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.234183 Aug 05 20:03:42.488556 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 65/131] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:42 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:42.827274 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-d47280ed-dac0-4036-a33c-3ccb918e0503 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:42.827896 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-d47280ed-dac0-4036-a33c-3ccb918e0503 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:42.835189 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d47280ed-dac0-4036-a33c-3ccb918e0503 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:42.835715 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d47280ed-dac0-4036-a33c-3ccb918e0503 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:42.837743 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d47280ed-dac0-4036-a33c-3ccb918e0503 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:42.838811 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d47280ed-dac0-4036-a33c-3ccb918e0503 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:42.839269 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d47280ed-dac0-4036-a33c-3ccb918e0503 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:42.839686 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d47280ed-dac0-4036-a33c-3ccb918e0503 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:43.323766 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-d47280ed-dac0-4036-a33c-3ccb918e0503 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:43.333766 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-d47280ed-dac0-4036-a33c-3ccb918e0503 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.511250 Aug 05 20:03:43.334487 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 67/132] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:42 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:43.509699 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-e4087924-9cf4-48b1-81b0-a027bfa397a4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:43.511322 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-e4087924-9cf4-48b1-81b0-a027bfa397a4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:43.520232 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e4087924-9cf4-48b1-81b0-a027bfa397a4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:43.520755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e4087924-9cf4-48b1-81b0-a027bfa397a4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:43.521193 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e4087924-9cf4-48b1-81b0-a027bfa397a4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:43.521924 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e4087924-9cf4-48b1-81b0-a027bfa397a4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:43.522375 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e4087924-9cf4-48b1-81b0-a027bfa397a4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:43.522818 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e4087924-9cf4-48b1-81b0-a027bfa397a4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:43.695249 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-e4087924-9cf4-48b1-81b0-a027bfa397a4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:43.703151 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-e4087924-9cf4-48b1-81b0-a027bfa397a4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.198742 Aug 05 20:03:43.703722 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 66/133] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:43 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:44.021607 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a64f76d4-c37a-44f9-97c7-fca922461d26 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66d74fde-80e1-4c0d-ba70-76e874d16bf1"}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:03:44.024257 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-a64f76d4-c37a-44f9-97c7-fca922461d26 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:44.026290 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=78 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:03:44.031826 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a64f76d4-c37a-44f9-97c7-fca922461d26 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:44.032885 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a64f76d4-c37a-44f9-97c7-fca922461d26 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:44.033681 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a64f76d4-c37a-44f9-97c7-fca922461d26 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:44.034400 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a64f76d4-c37a-44f9-97c7-fca922461d26 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:44.034843 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a64f76d4-c37a-44f9-97c7-fca922461d26 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:44.035266 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a64f76d4-c37a-44f9-97c7-fca922461d26 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:44.356398 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b0008b43-113a-46e7-94c6-f719b2363d2b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:44.357539 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-b0008b43-113a-46e7-94c6-f719b2363d2b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:44.367494 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b0008b43-113a-46e7-94c6-f719b2363d2b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:44.368077 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b0008b43-113a-46e7-94c6-f719b2363d2b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:44.368598 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b0008b43-113a-46e7-94c6-f719b2363d2b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:44.369472 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b0008b43-113a-46e7-94c6-f719b2363d2b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:44.369933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b0008b43-113a-46e7-94c6-f719b2363d2b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:44.370379 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b0008b43-113a-46e7-94c6-f719b2363d2b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:44.514695 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-b0008b43-113a-46e7-94c6-f719b2363d2b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:44.523104 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b0008b43-113a-46e7-94c6-f719b2363d2b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.170862 Aug 05 20:03:44.523678 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 67/134] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:44 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:44.723819 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-122060d9-1ee9-4b07-9fe6-2572773bcc36 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:44.724393 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-122060d9-1ee9-4b07-9fe6-2572773bcc36 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:44.726287 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=76 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:03:44.731777 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-122060d9-1ee9-4b07-9fe6-2572773bcc36 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:44.732284 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-122060d9-1ee9-4b07-9fe6-2572773bcc36 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:44.732739 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-122060d9-1ee9-4b07-9fe6-2572773bcc36 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:44.733435 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-122060d9-1ee9-4b07-9fe6-2572773bcc36 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:44.733891 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-122060d9-1ee9-4b07-9fe6-2572773bcc36 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:44.734319 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-122060d9-1ee9-4b07-9fe6-2572773bcc36 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:44.863444 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-122060d9-1ee9-4b07-9fe6-2572773bcc36 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:44.870994 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-122060d9-1ee9-4b07-9fe6-2572773bcc36 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.151694 Aug 05 20:03:44.871562 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 68/135] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:44 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:45.544422 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-0c52ac2e-a480-413e-ba1b-678983ed6ec2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:45.545179 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-0c52ac2e-a480-413e-ba1b-678983ed6ec2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:45.551860 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0c52ac2e-a480-413e-ba1b-678983ed6ec2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:45.552348 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0c52ac2e-a480-413e-ba1b-678983ed6ec2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:45.552892 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0c52ac2e-a480-413e-ba1b-678983ed6ec2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:45.553574 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0c52ac2e-a480-413e-ba1b-678983ed6ec2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:45.554023 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0c52ac2e-a480-413e-ba1b-678983ed6ec2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:45.554442 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0c52ac2e-a480-413e-ba1b-678983ed6ec2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:45.684762 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-0c52ac2e-a480-413e-ba1b-678983ed6ec2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:45.692982 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-0c52ac2e-a480-413e-ba1b-678983ed6ec2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.152398 Aug 05 20:03:45.693560 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 69/136] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:45 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:45.890967 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-179396c6-6136-4acf-82b9-197f0e0bda2e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:45.892109 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-179396c6-6136-4acf-82b9-197f0e0bda2e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:45.899089 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-179396c6-6136-4acf-82b9-197f0e0bda2e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:45.899587 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-179396c6-6136-4acf-82b9-197f0e0bda2e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:45.900025 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-179396c6-6136-4acf-82b9-197f0e0bda2e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:45.900771 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-179396c6-6136-4acf-82b9-197f0e0bda2e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:45.901229 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-179396c6-6136-4acf-82b9-197f0e0bda2e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:45.901782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-179396c6-6136-4acf-82b9-197f0e0bda2e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:46.029163 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-179396c6-6136-4acf-82b9-197f0e0bda2e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:46.037137 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-179396c6-6136-4acf-82b9-197f0e0bda2e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.149952 Aug 05 20:03:46.037696 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 70/137] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:45 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:46.714789 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-f15dd20c-bc5a-4730-84a6-346d2ce55b7a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:46.715433 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-f15dd20c-bc5a-4730-84a6-346d2ce55b7a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:46.721607 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f15dd20c-bc5a-4730-84a6-346d2ce55b7a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:46.722100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f15dd20c-bc5a-4730-84a6-346d2ce55b7a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:46.722535 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f15dd20c-bc5a-4730-84a6-346d2ce55b7a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:46.723236 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f15dd20c-bc5a-4730-84a6-346d2ce55b7a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:46.723687 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f15dd20c-bc5a-4730-84a6-346d2ce55b7a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:46.724116 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f15dd20c-bc5a-4730-84a6-346d2ce55b7a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:46.853586 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-f15dd20c-bc5a-4730-84a6-346d2ce55b7a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:46.861670 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-f15dd20c-bc5a-4730-84a6-346d2ce55b7a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.150666 Aug 05 20:03:46.862249 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 71/138] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:46 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:47.057974 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a2a8a43c-f37c-4ba5-8015-b785766379a5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:47.058614 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a2a8a43c-f37c-4ba5-8015-b785766379a5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:47.064542 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a2a8a43c-f37c-4ba5-8015-b785766379a5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:47.065268 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a2a8a43c-f37c-4ba5-8015-b785766379a5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:47.065714 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a2a8a43c-f37c-4ba5-8015-b785766379a5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:47.066418 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a2a8a43c-f37c-4ba5-8015-b785766379a5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:47.066876 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a2a8a43c-f37c-4ba5-8015-b785766379a5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:47.067304 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a2a8a43c-f37c-4ba5-8015-b785766379a5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:47.201101 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a2a8a43c-f37c-4ba5-8015-b785766379a5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:47.209571 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a2a8a43c-f37c-4ba5-8015-b785766379a5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.155435 Aug 05 20:03:47.210134 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 72/139] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:47 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:47.882787 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-7f623a57-e97d-4c82-a6eb-f64b1e09a199 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:47.883406 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-7f623a57-e97d-4c82-a6eb-f64b1e09a199 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:47.889465 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7f623a57-e97d-4c82-a6eb-f64b1e09a199 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:47.889950 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7f623a57-e97d-4c82-a6eb-f64b1e09a199 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:47.890379 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7f623a57-e97d-4c82-a6eb-f64b1e09a199 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:47.891156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7f623a57-e97d-4c82-a6eb-f64b1e09a199 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:47.892168 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7f623a57-e97d-4c82-a6eb-f64b1e09a199 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:47.892609 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7f623a57-e97d-4c82-a6eb-f64b1e09a199 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:48.021326 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-7f623a57-e97d-4c82-a6eb-f64b1e09a199 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:48.028679 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-7f623a57-e97d-4c82-a6eb-f64b1e09a199 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.149650 Aug 05 20:03:48.029237 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 73/140] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:47 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:48.229946 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-e36d25a8-0a37-4be7-84da-f499309f7487 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:48.230553 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-e36d25a8-0a37-4be7-84da-f499309f7487 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:48.237395 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e36d25a8-0a37-4be7-84da-f499309f7487 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:48.237874 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e36d25a8-0a37-4be7-84da-f499309f7487 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:48.238303 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e36d25a8-0a37-4be7-84da-f499309f7487 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:48.238980 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e36d25a8-0a37-4be7-84da-f499309f7487 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:48.239425 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e36d25a8-0a37-4be7-84da-f499309f7487 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:48.239858 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e36d25a8-0a37-4be7-84da-f499309f7487 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:48.371178 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-e36d25a8-0a37-4be7-84da-f499309f7487 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:48.379699 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-e36d25a8-0a37-4be7-84da-f499309f7487 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.153535 Aug 05 20:03:48.380978 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 74/141] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:48 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:49.048790 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-50aafc41-782c-480e-ab21-7cc758fe4de1 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:49.049793 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-50aafc41-782c-480e-ab21-7cc758fe4de1 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:49.058016 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-50aafc41-782c-480e-ab21-7cc758fe4de1 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:49.058666 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-50aafc41-782c-480e-ab21-7cc758fe4de1 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:49.059356 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-50aafc41-782c-480e-ab21-7cc758fe4de1 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:49.060492 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-50aafc41-782c-480e-ab21-7cc758fe4de1 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:49.061282 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-50aafc41-782c-480e-ab21-7cc758fe4de1 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:49.061967 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-50aafc41-782c-480e-ab21-7cc758fe4de1 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:49.194339 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-50aafc41-782c-480e-ab21-7cc758fe4de1 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:49.201806 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-50aafc41-782c-480e-ab21-7cc758fe4de1 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.157425 Aug 05 20:03:49.202373 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 75/142] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:49 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:49.400022 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-75c333ab-594b-4a0e-b17d-a93c6ba045ad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:49.400655 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-75c333ab-594b-4a0e-b17d-a93c6ba045ad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:49.406504 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-75c333ab-594b-4a0e-b17d-a93c6ba045ad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:49.407022 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-75c333ab-594b-4a0e-b17d-a93c6ba045ad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:49.408123 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-75c333ab-594b-4a0e-b17d-a93c6ba045ad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:49.408849 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-75c333ab-594b-4a0e-b17d-a93c6ba045ad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:49.409311 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-75c333ab-594b-4a0e-b17d-a93c6ba045ad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:49.409742 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-75c333ab-594b-4a0e-b17d-a93c6ba045ad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:49.546664 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-75c333ab-594b-4a0e-b17d-a93c6ba045ad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:49.556548 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-75c333ab-594b-4a0e-b17d-a93c6ba045ad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.160274 Aug 05 20:03:49.557310 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 76/143] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:49 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:50.015114 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-a64f76d4-c37a-44f9-97c7-fca922461d26 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "POST /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.998067 Aug 05 20:03:50.015905 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 68/144] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Aug 5 20:03:44 2022] POST /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645/os-volume_attachments => generated 194 bytes in 6000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:03:50.223820 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4b00b70d-5347-48ad-8275-80e3f34a3c07 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:50.224364 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-4b00b70d-5347-48ad-8275-80e3f34a3c07 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:50.230556 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4b00b70d-5347-48ad-8275-80e3f34a3c07 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:50.231043 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4b00b70d-5347-48ad-8275-80e3f34a3c07 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:50.231476 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4b00b70d-5347-48ad-8275-80e3f34a3c07 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:50.232158 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4b00b70d-5347-48ad-8275-80e3f34a3c07 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:50.232663 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4b00b70d-5347-48ad-8275-80e3f34a3c07 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:50.233088 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4b00b70d-5347-48ad-8275-80e3f34a3c07 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:50.359862 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-4b00b70d-5347-48ad-8275-80e3f34a3c07 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:50.368049 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-4b00b70d-5347-48ad-8275-80e3f34a3c07 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.148789 Aug 05 20:03:50.368627 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 77/145] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:50 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:50.577224 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-c90f2b6d-87f9-44c8-915c-959c293219ee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:50.577920 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-c90f2b6d-87f9-44c8-915c-959c293219ee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:50.585023 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c90f2b6d-87f9-44c8-915c-959c293219ee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:50.585505 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c90f2b6d-87f9-44c8-915c-959c293219ee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:50.585944 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c90f2b6d-87f9-44c8-915c-959c293219ee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:50.586633 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c90f2b6d-87f9-44c8-915c-959c293219ee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:50.587083 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c90f2b6d-87f9-44c8-915c-959c293219ee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:50.587506 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c90f2b6d-87f9-44c8-915c-959c293219ee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:50.918670 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-c90f2b6d-87f9-44c8-915c-959c293219ee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:50.926976 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-c90f2b6d-87f9-44c8-915c-959c293219ee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1322 microversion: 2.1 time: 0.353906 Aug 05 20:03:50.927555 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 69/146] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:50 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:51.388512 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-e20e3f46-1005-4b2a-9d81-c6a6c92618aa tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:51.389503 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-e20e3f46-1005-4b2a-9d81-c6a6c92618aa tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:51.395679 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e20e3f46-1005-4b2a-9d81-c6a6c92618aa tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:51.396162 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e20e3f46-1005-4b2a-9d81-c6a6c92618aa tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:51.396614 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e20e3f46-1005-4b2a-9d81-c6a6c92618aa tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:51.397304 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e20e3f46-1005-4b2a-9d81-c6a6c92618aa tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:51.397756 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e20e3f46-1005-4b2a-9d81-c6a6c92618aa tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:51.398175 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e20e3f46-1005-4b2a-9d81-c6a6c92618aa tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:51.530828 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-e20e3f46-1005-4b2a-9d81-c6a6c92618aa tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:51.539261 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-e20e3f46-1005-4b2a-9d81-c6a6c92618aa tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1367 microversion: 2.1 time: 0.154834 Aug 05 20:03:51.540033 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 78/147] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:51 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:51.926449 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-4d94dee4-5903-4ed8-8a09-26342c24cfa8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1458552514", "imageRef": "c148255e-9574-4d10-b9bb-13c9411eda77", "flavorRef": "452", "networks": [{"uuid": "504733f9-86e2-4cb9-86fb-5caac1b7dbda"}]}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:03:51.950255 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-e86fd91b-401e-4277-b85e-b952e78add0d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:51.950893 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-e86fd91b-401e-4277-b85e-b952e78add0d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:51.959844 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e86fd91b-401e-4277-b85e-b952e78add0d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:51.961170 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e86fd91b-401e-4277-b85e-b952e78add0d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:51.961801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e86fd91b-401e-4277-b85e-b952e78add0d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:51.962711 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e86fd91b-401e-4277-b85e-b952e78add0d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:51.963326 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e86fd91b-401e-4277-b85e-b952e78add0d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:51.963878 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e86fd91b-401e-4277-b85e-b952e78add0d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:51.982185 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.network.neutron [None req-4d94dee4-5903-4ed8-8a09-26342c24cfa8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] validate_networks() for [('504733f9-86e2-4cb9-86fb-5caac1b7dbda', None, None, None, None, None)] {{(pid=118191) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:03:52.180489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-e86fd91b-401e-4277-b85e-b952e78add0d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:52.196452 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-e86fd91b-401e-4277-b85e-b952e78add0d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1516 microversion: 2.1 time: 0.251854 Aug 05 20:03:52.197441 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 79/148] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:51 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1516 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:52.226200 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-dbccc88c-8fd3-4c1d-b106-a1aec885edb0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:03:52.229815 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-dbccc88c-8fd3-4c1d-b106-a1aec885edb0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:52.239359 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dbccc88c-8fd3-4c1d-b106-a1aec885edb0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:52.240243 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dbccc88c-8fd3-4c1d-b106-a1aec885edb0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:52.241216 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dbccc88c-8fd3-4c1d-b106-a1aec885edb0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:52.242201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dbccc88c-8fd3-4c1d-b106-a1aec885edb0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:52.242868 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dbccc88c-8fd3-4c1d-b106-a1aec885edb0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:52.243583 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dbccc88c-8fd3-4c1d-b106-a1aec885edb0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:52.313981 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.objects.instance [None req-dbccc88c-8fd3-4c1d-b106-a1aec885edb0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lazy-loading 'flavor' on Instance uuid c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d {{(pid=118192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:03:52.343906 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=100 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:03:52.441269 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-dbccc88c-8fd3-4c1d-b106-a1aec885edb0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "POST /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d/action" status: 200 len: 32 microversion: 2.1 time: 0.219337 Aug 05 20:03:52.442178 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 80/149] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Aug 5 20:03:52 2022] POST /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d/action => generated 32 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 05 20:03:52.451455 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ee9c7a24-5dc7-4416-9372-a34e11a2cd89 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:52.452219 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-ee9c7a24-5dc7-4416-9372-a34e11a2cd89 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:52.456813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-4d94dee4-5903-4ed8-8a09-26342c24cfa8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Flavor limits 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:03:52.457205 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-4d94dee4-5903-4ed8-8a09-26342c24cfa8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Image limits 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:03:52.457847 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-4d94dee4-5903-4ed8-8a09-26342c24cfa8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Flavor pref 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:03:52.458290 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-4d94dee4-5903-4ed8-8a09-26342c24cfa8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Image pref 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:03:52.458908 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-4d94dee4-5903-4ed8-8a09-26342c24cfa8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:03:52.459079 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ee9c7a24-5dc7-4416-9372-a34e11a2cd89 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:52.459590 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ee9c7a24-5dc7-4416-9372-a34e11a2cd89 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:52.460021 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ee9c7a24-5dc7-4416-9372-a34e11a2cd89 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:52.460751 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ee9c7a24-5dc7-4416-9372-a34e11a2cd89 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:52.461207 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ee9c7a24-5dc7-4416-9372-a34e11a2cd89 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:52.461638 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ee9c7a24-5dc7-4416-9372-a34e11a2cd89 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:52.468146 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4d94dee4-5903-4ed8-8a09-26342c24cfa8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:52.468742 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4d94dee4-5903-4ed8-8a09-26342c24cfa8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:52.469970 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4d94dee4-5903-4ed8-8a09-26342c24cfa8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:52.470917 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4d94dee4-5903-4ed8-8a09-26342c24cfa8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:52.471377 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4d94dee4-5903-4ed8-8a09-26342c24cfa8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:52.471805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4d94dee4-5903-4ed8-8a09-26342c24cfa8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:52.489203 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-4d94dee4-5903-4ed8-8a09-26342c24cfa8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Getting quotas for project 7a5caf50650e45fbb1872e277f56e3b3. Resources: {'cores', 'ram', 'instances'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:03:52.493760 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-4d94dee4-5903-4ed8-8a09-26342c24cfa8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Getting quotas for user ac0a233c84e1413490057c64654abe99 and project 7a5caf50650e45fbb1872e277f56e3b3. Resources: {'cores', 'ram', 'instances'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:03:52.506888 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-4d94dee4-5903-4ed8-8a09-26342c24cfa8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Going to run 1 instances... {{(pid=118191) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:03:52.509579 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-4d94dee4-5903-4ed8-8a09-26342c24cfa8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c148255e-9574-4d10-b9bb-13c9411eda77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118191) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:03:52.560464 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-4d94dee4-5903-4ed8-8a09-26342c24cfa8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638464 Aug 05 20:03:52.561424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 70/150] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Aug 5 20:03:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:03:52.571092 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7da2ec59-034c-4653-9556-68a1695e5c6b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:52.573392 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-7da2ec59-034c-4653-9556-68a1695e5c6b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:52.582496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7da2ec59-034c-4653-9556-68a1695e5c6b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:52.583179 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7da2ec59-034c-4653-9556-68a1695e5c6b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:52.583751 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7da2ec59-034c-4653-9556-68a1695e5c6b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:52.584653 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7da2ec59-034c-4653-9556-68a1695e5c6b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:52.585646 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7da2ec59-034c-4653-9556-68a1695e5c6b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:52.586324 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7da2ec59-034c-4653-9556-68a1695e5c6b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:52.624480 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-ee9c7a24-5dc7-4416-9372-a34e11a2cd89 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:52.643387 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-ee9c7a24-5dc7-4416-9372-a34e11a2cd89 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.195706 Aug 05 20:03:52.643988 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 81/151] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:52 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:52.651693 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-21387973-381b-43f4-a502-88881172fed4 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:52.652312 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-21387973-381b-43f4-a502-88881172fed4 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:52.723232 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-21387973-381b-43f4-a502-88881172fed4 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:52.731409 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-21387973-381b-43f4-a502-88881172fed4 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1219 microversion: 2.1 time: 0.083334 Aug 05 20:03:52.732252 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 82/152] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:52 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:52.775576 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-7da2ec59-034c-4653-9556-68a1695e5c6b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:52.785302 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-7da2ec59-034c-4653-9556-68a1695e5c6b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1558 microversion: 2.1 time: 0.222564 Aug 05 20:03:52.786198 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 71/153] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:52 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:52.807341 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-8a3d61fd-9563-4a2c-b068-a8f677267ced tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:52.808117 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-8a3d61fd-9563-4a2c-b068-a8f677267ced tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:52.814993 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8a3d61fd-9563-4a2c-b068-a8f677267ced tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:52.815513 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8a3d61fd-9563-4a2c-b068-a8f677267ced tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:52.816025 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8a3d61fd-9563-4a2c-b068-a8f677267ced tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:52.816762 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8a3d61fd-9563-4a2c-b068-a8f677267ced tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:52.817207 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8a3d61fd-9563-4a2c-b068-a8f677267ced tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:52.817628 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8a3d61fd-9563-4a2c-b068-a8f677267ced tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:52.912066 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-8a3d61fd-9563-4a2c-b068-a8f677267ced tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108160 Aug 05 20:03:52.912798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 83/154] 10.222.0.39 () {58 vars in 1275 bytes} [Fri Aug 5 20:03:52 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:03:53.664166 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-19afb99a-f8b5-4a83-a065-f178f5058278 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:53.665025 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-19afb99a-f8b5-4a83-a065-f178f5058278 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:53.676642 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-19afb99a-f8b5-4a83-a065-f178f5058278 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:53.678018 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-19afb99a-f8b5-4a83-a065-f178f5058278 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:53.678811 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-19afb99a-f8b5-4a83-a065-f178f5058278 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:53.681847 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-19afb99a-f8b5-4a83-a065-f178f5058278 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:53.682969 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-19afb99a-f8b5-4a83-a065-f178f5058278 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:53.685631 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-19afb99a-f8b5-4a83-a065-f178f5058278 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:53.754196 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-05f5a2cf-d031-4b0b-84f7-c8557d332bb8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:53.755510 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-05f5a2cf-d031-4b0b-84f7-c8557d332bb8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:53.768840 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-05f5a2cf-d031-4b0b-84f7-c8557d332bb8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:53.771014 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-05f5a2cf-d031-4b0b-84f7-c8557d332bb8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:53.771731 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-05f5a2cf-d031-4b0b-84f7-c8557d332bb8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:53.773801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-05f5a2cf-d031-4b0b-84f7-c8557d332bb8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:53.775212 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-05f5a2cf-d031-4b0b-84f7-c8557d332bb8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:53.776195 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-05f5a2cf-d031-4b0b-84f7-c8557d332bb8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:53.891953 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-05f5a2cf-d031-4b0b-84f7-c8557d332bb8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:53.901830 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-05f5a2cf-d031-4b0b-84f7-c8557d332bb8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1215 microversion: 2.1 time: 0.152550 Aug 05 20:03:53.903047 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 84/155] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:53 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1215 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:53.948528 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-19afb99a-f8b5-4a83-a065-f178f5058278 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:53.956645 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-19afb99a-f8b5-4a83-a065-f178f5058278 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.296321 Aug 05 20:03:53.957247 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 72/156] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:53 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:54.511944 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-25420709-39fd-40de-82e7-cc01e36af385 req-5060d0d1-1b1f-428a-a19f-333e54b3fe7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24ea172c-d11f-41e4-80d8-3f3e5f67cf90", "tag": "9d6aae7f-84e8-487b-8606-59afea4d7fad"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:03:54.522575 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-25420709-39fd-40de-82e7-cc01e36af385 req-5060d0d1-1b1f-428a-a19f-333e54b3fe7b service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:54.523138 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-25420709-39fd-40de-82e7-cc01e36af385 req-5060d0d1-1b1f-428a-a19f-333e54b3fe7b service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:54.523633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-25420709-39fd-40de-82e7-cc01e36af385 req-5060d0d1-1b1f-428a-a19f-333e54b3fe7b service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:54.535733 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-25420709-39fd-40de-82e7-cc01e36af385 req-5060d0d1-1b1f-428a-a19f-333e54b3fe7b service nova] Creating event network-changed:9d6aae7f-84e8-487b-8606-59afea4d7fad for instance 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 on hv-cinder-85221 Aug 05 20:03:54.541502 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-25420709-39fd-40de-82e7-cc01e36af385 req-5060d0d1-1b1f-428a-a19f-333e54b3fe7b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033713 Aug 05 20:03:54.542486 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 85/157] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:03:54.925292 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-cec6a739-7a0c-4138-a57f-191a7ec1ee14 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:54.926030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-cec6a739-7a0c-4138-a57f-191a7ec1ee14 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:54.933704 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cec6a739-7a0c-4138-a57f-191a7ec1ee14 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:54.934259 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cec6a739-7a0c-4138-a57f-191a7ec1ee14 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:54.934700 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cec6a739-7a0c-4138-a57f-191a7ec1ee14 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:54.935530 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cec6a739-7a0c-4138-a57f-191a7ec1ee14 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:54.936195 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cec6a739-7a0c-4138-a57f-191a7ec1ee14 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:54.936793 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cec6a739-7a0c-4138-a57f-191a7ec1ee14 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:54.980958 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-078c60b2-43c2-41db-b12b-c27c7f8d7c9d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:54.981817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-078c60b2-43c2-41db-b12b-c27c7f8d7c9d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:54.993045 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-078c60b2-43c2-41db-b12b-c27c7f8d7c9d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:54.993795 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-078c60b2-43c2-41db-b12b-c27c7f8d7c9d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:54.995040 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-078c60b2-43c2-41db-b12b-c27c7f8d7c9d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:54.995929 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-078c60b2-43c2-41db-b12b-c27c7f8d7c9d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:54.997285 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-078c60b2-43c2-41db-b12b-c27c7f8d7c9d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:54.997895 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-078c60b2-43c2-41db-b12b-c27c7f8d7c9d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:55.032860 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-cec6a739-7a0c-4138-a57f-191a7ec1ee14 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:55.041725 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-cec6a739-7a0c-4138-a57f-191a7ec1ee14 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1277 microversion: 2.1 time: 0.122004 Aug 05 20:03:55.042551 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 73/158] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:54 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:55.232123 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-078c60b2-43c2-41db-b12b-c27c7f8d7c9d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:55.242977 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-078c60b2-43c2-41db-b12b-c27c7f8d7c9d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.267529 Aug 05 20:03:55.249411 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 86/159] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:54 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:56.063256 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-09925047-3a7f-41b1-8f73-a8e0cafe0351 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:56.064025 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-09925047-3a7f-41b1-8f73-a8e0cafe0351 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:56.070927 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-09925047-3a7f-41b1-8f73-a8e0cafe0351 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:56.071681 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-09925047-3a7f-41b1-8f73-a8e0cafe0351 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:56.072372 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-09925047-3a7f-41b1-8f73-a8e0cafe0351 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:56.073363 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-09925047-3a7f-41b1-8f73-a8e0cafe0351 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:56.073982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-09925047-3a7f-41b1-8f73-a8e0cafe0351 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:56.074590 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-09925047-3a7f-41b1-8f73-a8e0cafe0351 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:56.264458 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-c2e255c7-a35f-4c76-8245-915304ad75df tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:56.265098 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-c2e255c7-a35f-4c76-8245-915304ad75df tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:56.272469 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c2e255c7-a35f-4c76-8245-915304ad75df tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:56.273021 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c2e255c7-a35f-4c76-8245-915304ad75df tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:56.273458 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c2e255c7-a35f-4c76-8245-915304ad75df tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:56.274156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c2e255c7-a35f-4c76-8245-915304ad75df tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:56.274611 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c2e255c7-a35f-4c76-8245-915304ad75df tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:56.275039 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c2e255c7-a35f-4c76-8245-915304ad75df tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:56.309960 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-09925047-3a7f-41b1-8f73-a8e0cafe0351 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:56.318583 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-09925047-3a7f-41b1-8f73-a8e0cafe0351 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1319 microversion: 2.1 time: 0.259622 Aug 05 20:03:56.319173 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 74/160] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:56 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:56.485861 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-c2e255c7-a35f-4c76-8245-915304ad75df tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:56.495307 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-c2e255c7-a35f-4c76-8245-915304ad75df tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.234934 Aug 05 20:03:56.496355 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 87/161] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:56 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:03:56.571333 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-7f98a95b-c884-4b20-817c-0c017feefe9e req-30393b66-a144-4021-b9f4-e4e297d0820e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf08b0d1-20cc-4376-a64e-ea887189202b", "tag": "215127cb-94a3-4b9b-a81a-bfba8a203583"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:03:56.581816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-7f98a95b-c884-4b20-817c-0c017feefe9e req-30393b66-a144-4021-b9f4-e4e297d0820e service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:56.582432 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-7f98a95b-c884-4b20-817c-0c017feefe9e req-30393b66-a144-4021-b9f4-e4e297d0820e service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:56.583042 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-7f98a95b-c884-4b20-817c-0c017feefe9e req-30393b66-a144-4021-b9f4-e4e297d0820e service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:56.597116 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-7f98a95b-c884-4b20-817c-0c017feefe9e req-30393b66-a144-4021-b9f4-e4e297d0820e service nova] Creating event network-changed:215127cb-94a3-4b9b-a81a-bfba8a203583 for instance bf08b0d1-20cc-4376-a64e-ea887189202b on hv-cinder-85221 Aug 05 20:03:56.613219 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-7f98a95b-c884-4b20-817c-0c017feefe9e req-30393b66-a144-4021-b9f4-e4e297d0820e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045398 Aug 05 20:03:56.613811 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 75/162] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:03:57.339577 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ff2460f9-8801-44b7-b8d8-c322da51f6a6 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:57.340189 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-ff2460f9-8801-44b7-b8d8-c322da51f6a6 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:57.346525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ff2460f9-8801-44b7-b8d8-c322da51f6a6 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:57.347181 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ff2460f9-8801-44b7-b8d8-c322da51f6a6 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:57.347609 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ff2460f9-8801-44b7-b8d8-c322da51f6a6 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:57.348303 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ff2460f9-8801-44b7-b8d8-c322da51f6a6 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:57.348774 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ff2460f9-8801-44b7-b8d8-c322da51f6a6 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:57.349193 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ff2460f9-8801-44b7-b8d8-c322da51f6a6 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:57.505611 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-ff2460f9-8801-44b7-b8d8-c322da51f6a6 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:57.515814 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-ff2460f9-8801-44b7-b8d8-c322da51f6a6 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1319 microversion: 2.1 time: 0.179787 Aug 05 20:03:57.517307 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 88/163] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:57 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:57.542162 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-0bea8dcd-c33c-442a-9c9d-a41f8af5219c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:57.543145 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-0bea8dcd-c33c-442a-9c9d-a41f8af5219c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:57.564101 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0bea8dcd-c33c-442a-9c9d-a41f8af5219c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:57.564627 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0bea8dcd-c33c-442a-9c9d-a41f8af5219c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:57.566464 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0bea8dcd-c33c-442a-9c9d-a41f8af5219c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:57.567204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0bea8dcd-c33c-442a-9c9d-a41f8af5219c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:57.567746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0bea8dcd-c33c-442a-9c9d-a41f8af5219c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:57.568348 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0bea8dcd-c33c-442a-9c9d-a41f8af5219c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:57.747155 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-0bea8dcd-c33c-442a-9c9d-a41f8af5219c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:57.755697 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-0bea8dcd-c33c-442a-9c9d-a41f8af5219c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.240227 Aug 05 20:03:57.756380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 76/164] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:57 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:58.542411 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-0a548881-a19f-426e-aeff-b58b2cc48bf3 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:58.543017 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-0a548881-a19f-426e-aeff-b58b2cc48bf3 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:58.570106 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0a548881-a19f-426e-aeff-b58b2cc48bf3 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:58.570606 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0a548881-a19f-426e-aeff-b58b2cc48bf3 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:58.571046 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0a548881-a19f-426e-aeff-b58b2cc48bf3 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:58.571811 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0a548881-a19f-426e-aeff-b58b2cc48bf3 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:58.572189 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0a548881-a19f-426e-aeff-b58b2cc48bf3 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:58.572627 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0a548881-a19f-426e-aeff-b58b2cc48bf3 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:58.721421 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-0a548881-a19f-426e-aeff-b58b2cc48bf3 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:58.729545 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-0a548881-a19f-426e-aeff-b58b2cc48bf3 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1319 microversion: 2.1 time: 0.190269 Aug 05 20:03:58.729797 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 89/165] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:58 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:58.776408 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-27243095-ee5e-4456-b28e-00c0fc2950fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:58.777058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-27243095-ee5e-4456-b28e-00c0fc2950fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:58.784276 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-27243095-ee5e-4456-b28e-00c0fc2950fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:58.784815 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-27243095-ee5e-4456-b28e-00c0fc2950fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:58.785253 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-27243095-ee5e-4456-b28e-00c0fc2950fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:58.785941 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-27243095-ee5e-4456-b28e-00c0fc2950fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:58.786407 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-27243095-ee5e-4456-b28e-00c0fc2950fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:58.786821 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-27243095-ee5e-4456-b28e-00c0fc2950fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:58.915324 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-27243095-ee5e-4456-b28e-00c0fc2950fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:58.923072 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-27243095-ee5e-4456-b28e-00c0fc2950fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.150408 Aug 05 20:03:58.923670 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 77/166] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:58 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:59.749663 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-3436ad22-690f-4a40-97eb-c6c64387378c tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:59.750337 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-3436ad22-690f-4a40-97eb-c6c64387378c tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:59.756090 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3436ad22-690f-4a40-97eb-c6c64387378c tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:59.756592 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3436ad22-690f-4a40-97eb-c6c64387378c tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:59.757039 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3436ad22-690f-4a40-97eb-c6c64387378c tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:59.757710 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3436ad22-690f-4a40-97eb-c6c64387378c tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:59.758157 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3436ad22-690f-4a40-97eb-c6c64387378c tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:59.758572 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3436ad22-690f-4a40-97eb-c6c64387378c tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:59.885594 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-3436ad22-690f-4a40-97eb-c6c64387378c tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:03:59.893331 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-3436ad22-690f-4a40-97eb-c6c64387378c tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1319 microversion: 2.1 time: 0.147446 Aug 05 20:03:59.893894 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 90/167] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:59 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:03:59.943759 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-1943c316-075b-4a09-8c70-47b29c024cbd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:03:59.944370 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-1943c316-075b-4a09-8c70-47b29c024cbd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:03:59.950620 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1943c316-075b-4a09-8c70-47b29c024cbd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:59.951092 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1943c316-075b-4a09-8c70-47b29c024cbd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:59.951515 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1943c316-075b-4a09-8c70-47b29c024cbd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:03:59.952187 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1943c316-075b-4a09-8c70-47b29c024cbd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:03:59.952651 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1943c316-075b-4a09-8c70-47b29c024cbd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:03:59.953071 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1943c316-075b-4a09-8c70-47b29c024cbd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:00.077673 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-1943c316-075b-4a09-8c70-47b29c024cbd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:00.085203 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-1943c316-075b-4a09-8c70-47b29c024cbd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.145255 Aug 05 20:04:00.085772 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 78/168] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:03:59 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:00.913321 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-c3757592-d62f-4b90-89f5-cfd9404c994d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:00.913932 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-c3757592-d62f-4b90-89f5-cfd9404c994d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:00.919825 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c3757592-d62f-4b90-89f5-cfd9404c994d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:00.920370 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c3757592-d62f-4b90-89f5-cfd9404c994d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:00.920778 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c3757592-d62f-4b90-89f5-cfd9404c994d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:00.921478 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c3757592-d62f-4b90-89f5-cfd9404c994d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:00.922489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c3757592-d62f-4b90-89f5-cfd9404c994d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:00.923511 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c3757592-d62f-4b90-89f5-cfd9404c994d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:01.053978 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-c3757592-d62f-4b90-89f5-cfd9404c994d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:01.061414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-c3757592-d62f-4b90-89f5-cfd9404c994d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1319 microversion: 2.1 time: 0.151968 Aug 05 20:04:01.061985 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 91/169] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:00 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:01.106887 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3335cd22-1f5c-4688-9abc-651cf1082fb5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:01.107440 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-3335cd22-1f5c-4688-9abc-651cf1082fb5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:01.114717 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3335cd22-1f5c-4688-9abc-651cf1082fb5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:01.115233 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3335cd22-1f5c-4688-9abc-651cf1082fb5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:01.115688 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3335cd22-1f5c-4688-9abc-651cf1082fb5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:01.116370 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3335cd22-1f5c-4688-9abc-651cf1082fb5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:01.116849 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3335cd22-1f5c-4688-9abc-651cf1082fb5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:01.117279 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3335cd22-1f5c-4688-9abc-651cf1082fb5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:01.247483 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3335cd22-1f5c-4688-9abc-651cf1082fb5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:01.255227 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3335cd22-1f5c-4688-9abc-651cf1082fb5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.152210 Aug 05 20:04:01.255791 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 79/170] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:01 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:02.083160 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a0198e5d-4f05-4f5d-b236-8b4eb84b3619 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:02.083967 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a0198e5d-4f05-4f5d-b236-8b4eb84b3619 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:02.090615 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a0198e5d-4f05-4f5d-b236-8b4eb84b3619 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:02.091186 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a0198e5d-4f05-4f5d-b236-8b4eb84b3619 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:02.091655 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a0198e5d-4f05-4f5d-b236-8b4eb84b3619 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:02.092442 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a0198e5d-4f05-4f5d-b236-8b4eb84b3619 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:02.092979 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a0198e5d-4f05-4f5d-b236-8b4eb84b3619 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:02.093421 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a0198e5d-4f05-4f5d-b236-8b4eb84b3619 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:02.275796 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-393f3acf-0f69-4c3b-a1a8-e34e3171cc00 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:02.276465 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-393f3acf-0f69-4c3b-a1a8-e34e3171cc00 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:02.283940 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-393f3acf-0f69-4c3b-a1a8-e34e3171cc00 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:02.284454 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-393f3acf-0f69-4c3b-a1a8-e34e3171cc00 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:02.284911 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-393f3acf-0f69-4c3b-a1a8-e34e3171cc00 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:02.285610 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-393f3acf-0f69-4c3b-a1a8-e34e3171cc00 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:02.286058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-393f3acf-0f69-4c3b-a1a8-e34e3171cc00 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:02.286479 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-393f3acf-0f69-4c3b-a1a8-e34e3171cc00 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:02.426047 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a0198e5d-4f05-4f5d-b236-8b4eb84b3619 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:02.435032 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a0198e5d-4f05-4f5d-b236-8b4eb84b3619 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1319 microversion: 2.1 time: 0.356215 Aug 05 20:04:02.435619 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 92/171] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:02 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1319 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:02.479524 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=2 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:02.501236 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=6 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:02.507386 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-393f3acf-0f69-4c3b-a1a8-e34e3171cc00 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:02.509512 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:02.516700 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-393f3acf-0f69-4c3b-a1a8-e34e3171cc00 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.244847 Aug 05 20:04:02.517267 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 80/172] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:02 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:03.455629 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-53dec508-652d-4a39-a041-0b8b3d55c488 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:03.456242 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-53dec508-652d-4a39-a041-0b8b3d55c488 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:03.458275 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell0:SELECT=2 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:03.463469 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53dec508-652d-4a39-a041-0b8b3d55c488 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:03.463949 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53dec508-652d-4a39-a041-0b8b3d55c488 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:03.464382 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53dec508-652d-4a39-a041-0b8b3d55c488 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:03.465115 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53dec508-652d-4a39-a041-0b8b3d55c488 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:03.465551 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53dec508-652d-4a39-a041-0b8b3d55c488 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:03.465974 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53dec508-652d-4a39-a041-0b8b3d55c488 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:03.539422 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-0ba17ad7-2716-411b-8fcd-2a7ce98024c3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:03.539965 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-0ba17ad7-2716-411b-8fcd-2a7ce98024c3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:03.549002 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0ba17ad7-2716-411b-8fcd-2a7ce98024c3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:03.549489 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0ba17ad7-2716-411b-8fcd-2a7ce98024c3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:03.549919 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0ba17ad7-2716-411b-8fcd-2a7ce98024c3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:03.550635 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0ba17ad7-2716-411b-8fcd-2a7ce98024c3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:03.551085 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0ba17ad7-2716-411b-8fcd-2a7ce98024c3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:03.551504 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0ba17ad7-2716-411b-8fcd-2a7ce98024c3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:03.610605 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-53dec508-652d-4a39-a041-0b8b3d55c488 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:03.618178 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-53dec508-652d-4a39-a041-0b8b3d55c488 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1319 microversion: 2.1 time: 0.166794 Aug 05 20:04:03.618760 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 93/173] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:03 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:03.696950 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-0ba17ad7-2716-411b-8fcd-2a7ce98024c3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:03.704600 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-0ba17ad7-2716-411b-8fcd-2a7ce98024c3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.169515 Aug 05 20:04:03.705165 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 81/174] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:03 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:04.638206 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-525cbac0-8bf3-43c1-b0a8-45c39923bbef tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:04.638826 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-525cbac0-8bf3-43c1-b0a8-45c39923bbef tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:04.645703 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-525cbac0-8bf3-43c1-b0a8-45c39923bbef tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:04.646191 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-525cbac0-8bf3-43c1-b0a8-45c39923bbef tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:04.646627 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-525cbac0-8bf3-43c1-b0a8-45c39923bbef tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:04.647330 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-525cbac0-8bf3-43c1-b0a8-45c39923bbef tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:04.647785 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-525cbac0-8bf3-43c1-b0a8-45c39923bbef tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:04.648213 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-525cbac0-8bf3-43c1-b0a8-45c39923bbef tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:04.725532 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a436c752-729a-4298-8a65-94a713f347e7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:04.726153 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-a436c752-729a-4298-8a65-94a713f347e7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:04.733089 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a436c752-729a-4298-8a65-94a713f347e7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:04.733501 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a436c752-729a-4298-8a65-94a713f347e7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:04.733929 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a436c752-729a-4298-8a65-94a713f347e7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:04.735237 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a436c752-729a-4298-8a65-94a713f347e7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:04.735779 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a436c752-729a-4298-8a65-94a713f347e7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:04.736197 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a436c752-729a-4298-8a65-94a713f347e7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:04.786788 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-525cbac0-8bf3-43c1-b0a8-45c39923bbef tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:04.794105 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-525cbac0-8bf3-43c1-b0a8-45c39923bbef tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1319 microversion: 2.1 time: 0.159775 Aug 05 20:04:04.794658 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 94/175] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:04 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:04.873244 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a436c752-729a-4298-8a65-94a713f347e7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:04.880875 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-a436c752-729a-4298-8a65-94a713f347e7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.159689 Aug 05 20:04:04.881451 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 82/176] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:04 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:05.816290 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-f7ce222e-86f0-4de5-bc4b-9b71b2dc9443 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:05.816926 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-f7ce222e-86f0-4de5-bc4b-9b71b2dc9443 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:05.822818 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f7ce222e-86f0-4de5-bc4b-9b71b2dc9443 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:05.823301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f7ce222e-86f0-4de5-bc4b-9b71b2dc9443 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:05.823734 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f7ce222e-86f0-4de5-bc4b-9b71b2dc9443 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:05.824418 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f7ce222e-86f0-4de5-bc4b-9b71b2dc9443 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:05.824934 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f7ce222e-86f0-4de5-bc4b-9b71b2dc9443 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:05.825357 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f7ce222e-86f0-4de5-bc4b-9b71b2dc9443 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:05.901904 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-92e32770-784c-4f92-8553-f9e1144cd5f3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:05.902525 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-92e32770-784c-4f92-8553-f9e1144cd5f3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:05.909884 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-92e32770-784c-4f92-8553-f9e1144cd5f3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:05.910370 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-92e32770-784c-4f92-8553-f9e1144cd5f3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:05.910806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-92e32770-784c-4f92-8553-f9e1144cd5f3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:05.911496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-92e32770-784c-4f92-8553-f9e1144cd5f3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:05.911949 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-92e32770-784c-4f92-8553-f9e1144cd5f3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:05.912373 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-92e32770-784c-4f92-8553-f9e1144cd5f3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:05.967120 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-f7ce222e-86f0-4de5-bc4b-9b71b2dc9443 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:05.975225 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-f7ce222e-86f0-4de5-bc4b-9b71b2dc9443 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1319 microversion: 2.1 time: 0.162974 Aug 05 20:04:05.976351 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 95/177] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:05 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:06.052888 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-92e32770-784c-4f92-8553-f9e1144cd5f3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:06.060806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-92e32770-784c-4f92-8553-f9e1144cd5f3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.162639 Aug 05 20:04:06.072972 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 83/178] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:05 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:06.995649 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-45773e62-c94b-4f05-adfa-4801d6e7309b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:06.996193 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-45773e62-c94b-4f05-adfa-4801d6e7309b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:07.002726 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-45773e62-c94b-4f05-adfa-4801d6e7309b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:07.003221 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-45773e62-c94b-4f05-adfa-4801d6e7309b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:07.003661 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-45773e62-c94b-4f05-adfa-4801d6e7309b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:07.004355 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-45773e62-c94b-4f05-adfa-4801d6e7309b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:07.004840 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-45773e62-c94b-4f05-adfa-4801d6e7309b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:07.005266 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-45773e62-c94b-4f05-adfa-4801d6e7309b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:07.082533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-01b83795-76d1-4aeb-8cd5-e11527ce8aab tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:07.083152 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-01b83795-76d1-4aeb-8cd5-e11527ce8aab tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:07.089574 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-01b83795-76d1-4aeb-8cd5-e11527ce8aab tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:07.090066 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-01b83795-76d1-4aeb-8cd5-e11527ce8aab tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:07.090507 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-01b83795-76d1-4aeb-8cd5-e11527ce8aab tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:07.091208 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-01b83795-76d1-4aeb-8cd5-e11527ce8aab tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:07.091671 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-01b83795-76d1-4aeb-8cd5-e11527ce8aab tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:07.092105 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-01b83795-76d1-4aeb-8cd5-e11527ce8aab tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:07.134741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-45773e62-c94b-4f05-adfa-4801d6e7309b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:07.143893 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-45773e62-c94b-4f05-adfa-4801d6e7309b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1319 microversion: 2.1 time: 0.151959 Aug 05 20:04:07.144830 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 96/179] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:06 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:07.231358 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-01b83795-76d1-4aeb-8cd5-e11527ce8aab tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:07.240152 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-01b83795-76d1-4aeb-8cd5-e11527ce8aab tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.161591 Aug 05 20:04:07.240750 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 84/180] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:07 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:08.164957 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-53e3bf6b-3b47-479a-ab68-b5f327a54e99 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:08.165579 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-53e3bf6b-3b47-479a-ab68-b5f327a54e99 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:08.171584 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53e3bf6b-3b47-479a-ab68-b5f327a54e99 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:08.172676 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53e3bf6b-3b47-479a-ab68-b5f327a54e99 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:08.173116 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53e3bf6b-3b47-479a-ab68-b5f327a54e99 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:08.173804 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53e3bf6b-3b47-479a-ab68-b5f327a54e99 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:08.174258 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53e3bf6b-3b47-479a-ab68-b5f327a54e99 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:08.174683 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53e3bf6b-3b47-479a-ab68-b5f327a54e99 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:08.189903 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:08.261025 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-499699ad-b9e0-46ac-9ea0-47fc9d4dd82c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:08.261787 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-499699ad-b9e0-46ac-9ea0-47fc9d4dd82c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:08.270419 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-499699ad-b9e0-46ac-9ea0-47fc9d4dd82c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:08.270419 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-499699ad-b9e0-46ac-9ea0-47fc9d4dd82c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:08.271250 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-499699ad-b9e0-46ac-9ea0-47fc9d4dd82c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:08.271690 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-499699ad-b9e0-46ac-9ea0-47fc9d4dd82c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:08.272148 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-499699ad-b9e0-46ac-9ea0-47fc9d4dd82c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:08.272596 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-499699ad-b9e0-46ac-9ea0-47fc9d4dd82c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:08.363791 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-53e3bf6b-3b47-479a-ab68-b5f327a54e99 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:08.371690 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-53e3bf6b-3b47-479a-ab68-b5f327a54e99 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1319 microversion: 2.1 time: 0.210706 Aug 05 20:04:08.372256 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 97/181] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:08 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:08.421024 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-499699ad-b9e0-46ac-9ea0-47fc9d4dd82c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:08.428891 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-499699ad-b9e0-46ac-9ea0-47fc9d4dd82c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.171623 Aug 05 20:04:08.429451 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 85/182] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:08 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:09.393312 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-fcd9293a-6b63-45b3-9445-fcaed63eadf4 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:09.393916 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-fcd9293a-6b63-45b3-9445-fcaed63eadf4 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:09.400218 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fcd9293a-6b63-45b3-9445-fcaed63eadf4 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:09.400664 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fcd9293a-6b63-45b3-9445-fcaed63eadf4 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:09.401094 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fcd9293a-6b63-45b3-9445-fcaed63eadf4 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:09.401768 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fcd9293a-6b63-45b3-9445-fcaed63eadf4 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:09.402214 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fcd9293a-6b63-45b3-9445-fcaed63eadf4 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:09.402629 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fcd9293a-6b63-45b3-9445-fcaed63eadf4 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:09.450729 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-cfbff4b3-5b3a-4371-8f4d-90cf2e9abf3d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:09.451590 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-cfbff4b3-5b3a-4371-8f4d-90cf2e9abf3d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:09.458600 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cfbff4b3-5b3a-4371-8f4d-90cf2e9abf3d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:09.459185 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cfbff4b3-5b3a-4371-8f4d-90cf2e9abf3d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:09.459705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cfbff4b3-5b3a-4371-8f4d-90cf2e9abf3d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:09.460466 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cfbff4b3-5b3a-4371-8f4d-90cf2e9abf3d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:09.461155 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cfbff4b3-5b3a-4371-8f4d-90cf2e9abf3d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:09.461673 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cfbff4b3-5b3a-4371-8f4d-90cf2e9abf3d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:09.618317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-fcd9293a-6b63-45b3-9445-fcaed63eadf4 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:09.626651 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-fcd9293a-6b63-45b3-9445-fcaed63eadf4 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1319 microversion: 2.1 time: 0.237655 Aug 05 20:04:09.628209 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 98/183] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:09 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:09.633531 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-cfbff4b3-5b3a-4371-8f4d-90cf2e9abf3d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:09.649888 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-cfbff4b3-5b3a-4371-8f4d-90cf2e9abf3d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.203461 Aug 05 20:04:09.650547 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 86/184] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:09 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:10.649722 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-26521d8d-1ce7-4fcf-b577-3907d0a105c9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:10.650329 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-26521d8d-1ce7-4fcf-b577-3907d0a105c9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:10.657122 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-26521d8d-1ce7-4fcf-b577-3907d0a105c9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:10.657602 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-26521d8d-1ce7-4fcf-b577-3907d0a105c9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:10.658032 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-26521d8d-1ce7-4fcf-b577-3907d0a105c9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:10.658716 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-26521d8d-1ce7-4fcf-b577-3907d0a105c9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:10.659163 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-26521d8d-1ce7-4fcf-b577-3907d0a105c9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:10.659586 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-26521d8d-1ce7-4fcf-b577-3907d0a105c9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:10.684946 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3ce46f78-b602-48d3-9b71-f2a1725e0f6f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:10.685562 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-3ce46f78-b602-48d3-9b71-f2a1725e0f6f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:10.692723 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3ce46f78-b602-48d3-9b71-f2a1725e0f6f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:10.693167 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3ce46f78-b602-48d3-9b71-f2a1725e0f6f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:10.693585 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3ce46f78-b602-48d3-9b71-f2a1725e0f6f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:10.694271 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3ce46f78-b602-48d3-9b71-f2a1725e0f6f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:10.694720 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3ce46f78-b602-48d3-9b71-f2a1725e0f6f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:10.695135 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3ce46f78-b602-48d3-9b71-f2a1725e0f6f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:10.878998 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-26521d8d-1ce7-4fcf-b577-3907d0a105c9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:10.887313 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-26521d8d-1ce7-4fcf-b577-3907d0a105c9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1319 microversion: 2.1 time: 0.241296 Aug 05 20:04:10.887835 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 99/185] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:10 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:10.894577 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3ce46f78-b602-48d3-9b71-f2a1725e0f6f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:10.902422 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3ce46f78-b602-48d3-9b71-f2a1725e0f6f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.221203 Aug 05 20:04:10.903264 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 87/186] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:10 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:11.200816 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-5f2f9948-a340-48c0-b814-fd97513a639e req-9400d5a5-663c-411b-a907-c228c9a51080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf08b0d1-20cc-4376-a64e-ea887189202b", "name": "network-vif-plugged", "status": "completed", "tag": "215127cb-94a3-4b9b-a81a-bfba8a203583"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:04:11.211304 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-5f2f9948-a340-48c0-b814-fd97513a639e req-9400d5a5-663c-411b-a907-c228c9a51080 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:11.211898 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-5f2f9948-a340-48c0-b814-fd97513a639e req-9400d5a5-663c-411b-a907-c228c9a51080 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:11.212463 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-5f2f9948-a340-48c0-b814-fd97513a639e req-9400d5a5-663c-411b-a907-c228c9a51080 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:11.224718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-5f2f9948-a340-48c0-b814-fd97513a639e req-9400d5a5-663c-411b-a907-c228c9a51080 service nova] Creating event network-vif-plugged:215127cb-94a3-4b9b-a81a-bfba8a203583 for instance bf08b0d1-20cc-4376-a64e-ea887189202b on hv-cinder-85221 Aug 05 20:04:11.230090 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-5f2f9948-a340-48c0-b814-fd97513a639e req-9400d5a5-663c-411b-a907-c228c9a51080 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033061 Aug 05 20:04:11.231018 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 100/187] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:04:11.911046 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-bd0a6893-bca9-4d94-b3f7-62ca20ccab7a tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:11.911802 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-bd0a6893-bca9-4d94-b3f7-62ca20ccab7a tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:11.918318 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bd0a6893-bca9-4d94-b3f7-62ca20ccab7a tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:11.918814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bd0a6893-bca9-4d94-b3f7-62ca20ccab7a tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:11.919252 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bd0a6893-bca9-4d94-b3f7-62ca20ccab7a tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:11.919950 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bd0a6893-bca9-4d94-b3f7-62ca20ccab7a tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:11.920404 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bd0a6893-bca9-4d94-b3f7-62ca20ccab7a tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:11.920855 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bd0a6893-bca9-4d94-b3f7-62ca20ccab7a tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:11.927771 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-40c87cb1-0ee3-47ac-8332-9b0bf52589fb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:11.928615 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-40c87cb1-0ee3-47ac-8332-9b0bf52589fb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:11.934821 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-40c87cb1-0ee3-47ac-8332-9b0bf52589fb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:11.935295 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-40c87cb1-0ee3-47ac-8332-9b0bf52589fb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:11.935725 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-40c87cb1-0ee3-47ac-8332-9b0bf52589fb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:11.936417 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-40c87cb1-0ee3-47ac-8332-9b0bf52589fb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:11.937714 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-40c87cb1-0ee3-47ac-8332-9b0bf52589fb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:11.938413 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-40c87cb1-0ee3-47ac-8332-9b0bf52589fb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:12.304187 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-bd0a6893-bca9-4d94-b3f7-62ca20ccab7a tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:12.324914 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-bd0a6893-bca9-4d94-b3f7-62ca20ccab7a tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1319 microversion: 2.1 time: 0.415230 Aug 05 20:04:12.325857 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 88/188] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:11 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:12.360236 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-40c87cb1-0ee3-47ac-8332-9b0bf52589fb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:12.371204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-40c87cb1-0ee3-47ac-8332-9b0bf52589fb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.447172 Aug 05 20:04:12.371634 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 101/189] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:11 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:13.347501 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-ef6e4a83-7dab-44d7-89a2-59eb99a75173 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:13.348421 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-ef6e4a83-7dab-44d7-89a2-59eb99a75173 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:13.355273 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ef6e4a83-7dab-44d7-89a2-59eb99a75173 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:13.355851 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ef6e4a83-7dab-44d7-89a2-59eb99a75173 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:13.356294 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ef6e4a83-7dab-44d7-89a2-59eb99a75173 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:13.357123 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ef6e4a83-7dab-44d7-89a2-59eb99a75173 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:13.357645 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ef6e4a83-7dab-44d7-89a2-59eb99a75173 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:13.358308 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ef6e4a83-7dab-44d7-89a2-59eb99a75173 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:13.396403 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-57faeac6-4e79-4b45-b8da-edc407d8d876 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:13.402483 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-57faeac6-4e79-4b45-b8da-edc407d8d876 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:13.417998 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-57faeac6-4e79-4b45-b8da-edc407d8d876 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:13.418524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-57faeac6-4e79-4b45-b8da-edc407d8d876 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:13.419020 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-57faeac6-4e79-4b45-b8da-edc407d8d876 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:13.420031 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-57faeac6-4e79-4b45-b8da-edc407d8d876 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:13.420850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-57faeac6-4e79-4b45-b8da-edc407d8d876 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:13.422288 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-57faeac6-4e79-4b45-b8da-edc407d8d876 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:13.738981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-ef6e4a83-7dab-44d7-89a2-59eb99a75173 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:13.748981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-ef6e4a83-7dab-44d7-89a2-59eb99a75173 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1319 microversion: 2.1 time: 0.406282 Aug 05 20:04:13.750795 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 89/190] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:13 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1319 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:13.787633 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-d99c5d59-2071-4e18-bf6e-178cc7ee4a95 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:13.788838 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-d99c5d59-2071-4e18-bf6e-178cc7ee4a95 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:13.794872 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d99c5d59-2071-4e18-bf6e-178cc7ee4a95 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:13.795484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d99c5d59-2071-4e18-bf6e-178cc7ee4a95 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:13.795989 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d99c5d59-2071-4e18-bf6e-178cc7ee4a95 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:13.797385 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d99c5d59-2071-4e18-bf6e-178cc7ee4a95 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:13.797961 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d99c5d59-2071-4e18-bf6e-178cc7ee4a95 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:13.798456 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d99c5d59-2071-4e18-bf6e-178cc7ee4a95 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:13.824225 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-57faeac6-4e79-4b45-b8da-edc407d8d876 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:13.825884 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-d99c5d59-2071-4e18-bf6e-178cc7ee4a95 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Going to try to terminate instance {{(pid=118191) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:04:13.834162 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-57faeac6-4e79-4b45-b8da-edc407d8d876 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.443972 Aug 05 20:04:13.834743 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 102/191] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:13 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:13.918262 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-d99c5d59-2071-4e18-bf6e-178cc7ee4a95 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "DELETE /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 204 len: 0 microversion: 2.1 time: 0.134200 Aug 05 20:04:13.918837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 90/192] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:04:13 2022] DELETE /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 05 20:04:13.927983 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-1a9890b9-38fe-42a8-93b0-cd0c319c94e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:13.928746 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-1a9890b9-38fe-42a8-93b0-cd0c319c94e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:13.935064 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1a9890b9-38fe-42a8-93b0-cd0c319c94e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:13.935646 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1a9890b9-38fe-42a8-93b0-cd0c319c94e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:13.936145 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1a9890b9-38fe-42a8-93b0-cd0c319c94e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:13.937504 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1a9890b9-38fe-42a8-93b0-cd0c319c94e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:13.938029 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1a9890b9-38fe-42a8-93b0-cd0c319c94e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:13.938514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1a9890b9-38fe-42a8-93b0-cd0c319c94e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:14.074542 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-1a9890b9-38fe-42a8-93b0-cd0c319c94e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:14.083542 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-1a9890b9-38fe-42a8-93b0-cd0c319c94e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1554 microversion: 2.1 time: 0.159636 Aug 05 20:04:14.084017 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 103/193] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:13 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:14.771687 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7a428294-fa5b-44f3-a6cc-013892af5cfb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:14.772318 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-7a428294-fa5b-44f3-a6cc-013892af5cfb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:14.774290 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:14.780061 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7a428294-fa5b-44f3-a6cc-013892af5cfb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:14.780614 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7a428294-fa5b-44f3-a6cc-013892af5cfb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:14.781038 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7a428294-fa5b-44f3-a6cc-013892af5cfb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:14.781801 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7a428294-fa5b-44f3-a6cc-013892af5cfb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:14.782262 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7a428294-fa5b-44f3-a6cc-013892af5cfb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:14.782691 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7a428294-fa5b-44f3-a6cc-013892af5cfb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:14.854930 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-cb11f3ae-b076-49e7-9f2b-71ff1570967c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:14.855547 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-cb11f3ae-b076-49e7-9f2b-71ff1570967c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:14.857560 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=74 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:14.863435 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cb11f3ae-b076-49e7-9f2b-71ff1570967c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:14.863997 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cb11f3ae-b076-49e7-9f2b-71ff1570967c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:14.864496 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cb11f3ae-b076-49e7-9f2b-71ff1570967c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:14.865280 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cb11f3ae-b076-49e7-9f2b-71ff1570967c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:14.865801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cb11f3ae-b076-49e7-9f2b-71ff1570967c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:14.866306 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cb11f3ae-b076-49e7-9f2b-71ff1570967c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:14.944719 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-7a428294-fa5b-44f3-a6cc-013892af5cfb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:14.952198 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-7a428294-fa5b-44f3-a6cc-013892af5cfb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1319 microversion: 2.1 time: 0.185149 Aug 05 20:04:14.953545 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 91/194] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:14 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:15.009564 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-cb11f3ae-b076-49e7-9f2b-71ff1570967c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:15.017890 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-cb11f3ae-b076-49e7-9f2b-71ff1570967c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.167006 Aug 05 20:04:15.018463 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 104/195] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:14 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:15.105233 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-83b6b637-2f66-492e-900d-c10e6a063818 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:15.105762 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-83b6b637-2f66-492e-900d-c10e6a063818 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:15.112164 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-83b6b637-2f66-492e-900d-c10e6a063818 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:15.112695 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-83b6b637-2f66-492e-900d-c10e6a063818 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:15.113113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-83b6b637-2f66-492e-900d-c10e6a063818 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:15.113797 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-83b6b637-2f66-492e-900d-c10e6a063818 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:15.114246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-83b6b637-2f66-492e-900d-c10e6a063818 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:15.114670 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-83b6b637-2f66-492e-900d-c10e6a063818 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:15.248400 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-83b6b637-2f66-492e-900d-c10e6a063818 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:15.256441 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-83b6b637-2f66-492e-900d-c10e6a063818 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1554 microversion: 2.1 time: 0.155174 Aug 05 20:04:15.257055 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 92/196] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:15 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:15.974592 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-6bb2b68d-2d54-4a9a-b4d1-c0e2640edeea tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:15.975202 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-6bb2b68d-2d54-4a9a-b4d1-c0e2640edeea tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:15.984205 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6bb2b68d-2d54-4a9a-b4d1-c0e2640edeea tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:15.984536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6bb2b68d-2d54-4a9a-b4d1-c0e2640edeea tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:15.985075 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6bb2b68d-2d54-4a9a-b4d1-c0e2640edeea tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:15.985766 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6bb2b68d-2d54-4a9a-b4d1-c0e2640edeea tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:15.986217 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6bb2b68d-2d54-4a9a-b4d1-c0e2640edeea tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:15.986636 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6bb2b68d-2d54-4a9a-b4d1-c0e2640edeea tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:16.044712 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-98e6c98f-2e36-4285-9773-205eeddeff62 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:16.045334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-98e6c98f-2e36-4285-9773-205eeddeff62 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:16.056846 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-98e6c98f-2e36-4285-9773-205eeddeff62 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:16.057344 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-98e6c98f-2e36-4285-9773-205eeddeff62 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:16.058497 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-98e6c98f-2e36-4285-9773-205eeddeff62 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:16.059220 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-98e6c98f-2e36-4285-9773-205eeddeff62 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:16.059799 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-98e6c98f-2e36-4285-9773-205eeddeff62 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:16.060227 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-98e6c98f-2e36-4285-9773-205eeddeff62 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:16.171523 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-6bb2b68d-2d54-4a9a-b4d1-c0e2640edeea tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:16.179583 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-6bb2b68d-2d54-4a9a-b4d1-c0e2640edeea tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1319 microversion: 2.1 time: 0.208922 Aug 05 20:04:16.180151 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 105/197] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:15 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:16.215826 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-98e6c98f-2e36-4285-9773-205eeddeff62 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:16.223730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-98e6c98f-2e36-4285-9773-205eeddeff62 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.184925 Aug 05 20:04:16.224294 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 93/198] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:16 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:16.279047 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-cfd2efb5-ae7c-4f4f-ba9e-050e25838bfb tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:16.279649 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-cfd2efb5-ae7c-4f4f-ba9e-050e25838bfb tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:16.286697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cfd2efb5-ae7c-4f4f-ba9e-050e25838bfb tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:16.287188 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cfd2efb5-ae7c-4f4f-ba9e-050e25838bfb tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:16.287626 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cfd2efb5-ae7c-4f4f-ba9e-050e25838bfb tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:16.288329 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cfd2efb5-ae7c-4f4f-ba9e-050e25838bfb tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:16.288828 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cfd2efb5-ae7c-4f4f-ba9e-050e25838bfb tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:16.289272 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cfd2efb5-ae7c-4f4f-ba9e-050e25838bfb tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:16.417298 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-cfd2efb5-ae7c-4f4f-ba9e-050e25838bfb tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:16.425896 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-cfd2efb5-ae7c-4f4f-ba9e-050e25838bfb tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1554 microversion: 2.1 time: 0.150578 Aug 05 20:04:16.426399 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 106/199] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:16 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:17.201055 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7998c781-e5d3-4311-a766-df1ea1db9890 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:17.201669 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-7998c781-e5d3-4311-a766-df1ea1db9890 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:17.208853 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7998c781-e5d3-4311-a766-df1ea1db9890 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:17.209342 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7998c781-e5d3-4311-a766-df1ea1db9890 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:17.209771 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7998c781-e5d3-4311-a766-df1ea1db9890 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:17.210458 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7998c781-e5d3-4311-a766-df1ea1db9890 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:17.210909 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7998c781-e5d3-4311-a766-df1ea1db9890 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:17.211351 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7998c781-e5d3-4311-a766-df1ea1db9890 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:17.244932 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-657b199e-23a1-480c-bd0b-bfbf55ce9669 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:17.245562 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-657b199e-23a1-480c-bd0b-bfbf55ce9669 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:17.252988 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-657b199e-23a1-480c-bd0b-bfbf55ce9669 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:17.253745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-657b199e-23a1-480c-bd0b-bfbf55ce9669 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:17.254252 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-657b199e-23a1-480c-bd0b-bfbf55ce9669 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:17.255159 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-657b199e-23a1-480c-bd0b-bfbf55ce9669 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:17.255621 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-657b199e-23a1-480c-bd0b-bfbf55ce9669 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:17.256040 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-657b199e-23a1-480c-bd0b-bfbf55ce9669 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:17.402664 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-7998c781-e5d3-4311-a766-df1ea1db9890 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:17.419686 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-7998c781-e5d3-4311-a766-df1ea1db9890 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1506 microversion: 2.1 time: 0.222415 Aug 05 20:04:17.420290 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 94/200] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:17 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1506 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:17.434788 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-657b199e-23a1-480c-bd0b-bfbf55ce9669 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:17.446211 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-657b199e-23a1-480c-bd0b-bfbf55ce9669 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.204923 Aug 05 20:04:17.446312 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-4304adc0-d862-4286-a34e-2967f72c0376 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:17.446940 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-4304adc0-d862-4286-a34e-2967f72c0376 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:17.448250 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 107/201] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:17 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:17.454118 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4304adc0-d862-4286-a34e-2967f72c0376 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:17.454970 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4304adc0-d862-4286-a34e-2967f72c0376 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:17.455557 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4304adc0-d862-4286-a34e-2967f72c0376 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:17.456397 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4304adc0-d862-4286-a34e-2967f72c0376 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:17.457036 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4304adc0-d862-4286-a34e-2967f72c0376 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:17.457606 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4304adc0-d862-4286-a34e-2967f72c0376 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:17.604117 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-4304adc0-d862-4286-a34e-2967f72c0376 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:17.606389 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:17.615086 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-4304adc0-d862-4286-a34e-2967f72c0376 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1554 microversion: 2.1 time: 0.172530 Aug 05 20:04:17.615729 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 95/202] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:17 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:18.470243 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-9ea8bc07-af9c-41bf-b291-1eff8b9b06e4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:18.470865 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-9ea8bc07-af9c-41bf-b291-1eff8b9b06e4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:18.476823 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9ea8bc07-af9c-41bf-b291-1eff8b9b06e4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:18.477306 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9ea8bc07-af9c-41bf-b291-1eff8b9b06e4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:18.477737 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9ea8bc07-af9c-41bf-b291-1eff8b9b06e4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:18.478429 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9ea8bc07-af9c-41bf-b291-1eff8b9b06e4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:18.478880 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9ea8bc07-af9c-41bf-b291-1eff8b9b06e4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:18.479305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9ea8bc07-af9c-41bf-b291-1eff8b9b06e4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:18.612123 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-9ea8bc07-af9c-41bf-b291-1eff8b9b06e4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:18.619515 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-9ea8bc07-af9c-41bf-b291-1eff8b9b06e4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.154048 Aug 05 20:04:18.620082 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 108/203] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:18 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:18.636279 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-127e27a4-608d-4b1c-9bec-e2ff5aa19537 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:18.636910 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-127e27a4-608d-4b1c-9bec-e2ff5aa19537 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:18.644453 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-127e27a4-608d-4b1c-9bec-e2ff5aa19537 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:18.644972 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-127e27a4-608d-4b1c-9bec-e2ff5aa19537 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:18.645397 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-127e27a4-608d-4b1c-9bec-e2ff5aa19537 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:18.646071 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-127e27a4-608d-4b1c-9bec-e2ff5aa19537 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:18.646513 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-127e27a4-608d-4b1c-9bec-e2ff5aa19537 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:18.646928 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-127e27a4-608d-4b1c-9bec-e2ff5aa19537 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:18.775976 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-127e27a4-608d-4b1c-9bec-e2ff5aa19537 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:18.784134 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-127e27a4-608d-4b1c-9bec-e2ff5aa19537 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1554 microversion: 2.1 time: 0.151539 Aug 05 20:04:18.784676 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 96/204] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:18 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:19.640964 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4651dadc-fdd8-431f-963d-09ee7cd62ed4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:19.641605 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-4651dadc-fdd8-431f-963d-09ee7cd62ed4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:19.647800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4651dadc-fdd8-431f-963d-09ee7cd62ed4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:19.648288 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4651dadc-fdd8-431f-963d-09ee7cd62ed4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:19.648765 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4651dadc-fdd8-431f-963d-09ee7cd62ed4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:19.649457 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4651dadc-fdd8-431f-963d-09ee7cd62ed4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:19.649915 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4651dadc-fdd8-431f-963d-09ee7cd62ed4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:19.650344 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4651dadc-fdd8-431f-963d-09ee7cd62ed4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:19.782833 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-4651dadc-fdd8-431f-963d-09ee7cd62ed4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:19.790175 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-4651dadc-fdd8-431f-963d-09ee7cd62ed4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.153806 Aug 05 20:04:19.790743 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 109/205] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:19 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:19.805339 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-c000444a-b009-4bb7-88cd-f30ac89a6879 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:19.805958 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-c000444a-b009-4bb7-88cd-f30ac89a6879 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:19.812551 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c000444a-b009-4bb7-88cd-f30ac89a6879 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:19.813016 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c000444a-b009-4bb7-88cd-f30ac89a6879 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:19.813449 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c000444a-b009-4bb7-88cd-f30ac89a6879 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:19.814139 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c000444a-b009-4bb7-88cd-f30ac89a6879 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:19.814594 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c000444a-b009-4bb7-88cd-f30ac89a6879 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:19.815022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c000444a-b009-4bb7-88cd-f30ac89a6879 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:19.942340 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-c000444a-b009-4bb7-88cd-f30ac89a6879 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:19.951917 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-c000444a-b009-4bb7-88cd-f30ac89a6879 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1554 microversion: 2.1 time: 0.150335 Aug 05 20:04:19.956109 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 97/206] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:19 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:20.810835 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-e5b9bd48-6a04-4953-9278-1e1079375de2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:20.812219 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-e5b9bd48-6a04-4953-9278-1e1079375de2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:20.818151 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e5b9bd48-6a04-4953-9278-1e1079375de2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:20.818663 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e5b9bd48-6a04-4953-9278-1e1079375de2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:20.819098 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e5b9bd48-6a04-4953-9278-1e1079375de2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:20.819793 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e5b9bd48-6a04-4953-9278-1e1079375de2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:20.820247 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e5b9bd48-6a04-4953-9278-1e1079375de2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:20.820699 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e5b9bd48-6a04-4953-9278-1e1079375de2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:20.948990 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-e5b9bd48-6a04-4953-9278-1e1079375de2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:20.957062 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-e5b9bd48-6a04-4953-9278-1e1079375de2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.150028 Aug 05 20:04:20.957626 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 110/207] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:20 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:20.973148 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-2d6e749c-c1b8-484f-a8b9-43accfaee535 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:20.973763 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-2d6e749c-c1b8-484f-a8b9-43accfaee535 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:20.980282 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2d6e749c-c1b8-484f-a8b9-43accfaee535 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:20.980827 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2d6e749c-c1b8-484f-a8b9-43accfaee535 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:20.981302 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2d6e749c-c1b8-484f-a8b9-43accfaee535 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:20.982003 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2d6e749c-c1b8-484f-a8b9-43accfaee535 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:20.982462 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2d6e749c-c1b8-484f-a8b9-43accfaee535 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:20.982892 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2d6e749c-c1b8-484f-a8b9-43accfaee535 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:21.125309 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-2d6e749c-c1b8-484f-a8b9-43accfaee535 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:21.133148 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-2d6e749c-c1b8-484f-a8b9-43accfaee535 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1554 microversion: 2.1 time: 0.163885 Aug 05 20:04:21.133719 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 98/208] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:20 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:21.977854 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ef29f298-157b-4556-b9c3-e58b1dce903a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:21.978381 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-ef29f298-157b-4556-b9c3-e58b1dce903a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:21.985033 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ef29f298-157b-4556-b9c3-e58b1dce903a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:21.985515 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ef29f298-157b-4556-b9c3-e58b1dce903a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:21.986101 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ef29f298-157b-4556-b9c3-e58b1dce903a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:21.986781 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ef29f298-157b-4556-b9c3-e58b1dce903a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:21.987231 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ef29f298-157b-4556-b9c3-e58b1dce903a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:21.987651 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ef29f298-157b-4556-b9c3-e58b1dce903a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:22.136649 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-ef29f298-157b-4556-b9c3-e58b1dce903a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:22.144786 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-ef29f298-157b-4556-b9c3-e58b1dce903a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.170518 Aug 05 20:04:22.145365 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 111/209] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:21 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:22.154755 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-d9b83c99-2939-4011-a223-8e3bc260061c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:22.155431 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-d9b83c99-2939-4011-a223-8e3bc260061c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:22.162059 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d9b83c99-2939-4011-a223-8e3bc260061c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:22.162546 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d9b83c99-2939-4011-a223-8e3bc260061c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:22.162985 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d9b83c99-2939-4011-a223-8e3bc260061c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:22.163673 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d9b83c99-2939-4011-a223-8e3bc260061c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:22.164128 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d9b83c99-2939-4011-a223-8e3bc260061c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:22.164556 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d9b83c99-2939-4011-a223-8e3bc260061c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:22.301050 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-d9b83c99-2939-4011-a223-8e3bc260061c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:22.309025 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-d9b83c99-2939-4011-a223-8e3bc260061c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1554 microversion: 2.1 time: 0.158092 Aug 05 20:04:22.309698 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 99/210] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:22 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:23.167121 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-59b3eeae-1753-4f9f-8895-5db3ceb01567 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:23.167894 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-59b3eeae-1753-4f9f-8895-5db3ceb01567 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:23.175110 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-59b3eeae-1753-4f9f-8895-5db3ceb01567 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:23.175672 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-59b3eeae-1753-4f9f-8895-5db3ceb01567 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:23.176375 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-59b3eeae-1753-4f9f-8895-5db3ceb01567 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:23.177202 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-59b3eeae-1753-4f9f-8895-5db3ceb01567 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:23.177663 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-59b3eeae-1753-4f9f-8895-5db3ceb01567 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:23.178101 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-59b3eeae-1753-4f9f-8895-5db3ceb01567 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:23.317843 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-59b3eeae-1753-4f9f-8895-5db3ceb01567 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:23.335586 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-b1099321-d2ec-474f-a8aa-05c952149ad9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:23.335586 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-b1099321-d2ec-474f-a8aa-05c952149ad9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:23.338439 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b1099321-d2ec-474f-a8aa-05c952149ad9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:23.338931 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b1099321-d2ec-474f-a8aa-05c952149ad9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:23.339369 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b1099321-d2ec-474f-a8aa-05c952149ad9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:23.340075 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b1099321-d2ec-474f-a8aa-05c952149ad9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:23.340533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b1099321-d2ec-474f-a8aa-05c952149ad9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:23.340991 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b1099321-d2ec-474f-a8aa-05c952149ad9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:23.342450 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-59b3eeae-1753-4f9f-8895-5db3ceb01567 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.181110 Aug 05 20:04:23.343048 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 112/211] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:23 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:23.477201 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-b1099321-d2ec-474f-a8aa-05c952149ad9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:23.486657 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-b1099321-d2ec-474f-a8aa-05c952149ad9 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1554 microversion: 2.1 time: 0.159938 Aug 05 20:04:23.487494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 100/212] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:23 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:24.363931 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a231caa1-b327-428f-b8b6-7f78ef884ac2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:24.364539 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a231caa1-b327-428f-b8b6-7f78ef884ac2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:24.370750 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a231caa1-b327-428f-b8b6-7f78ef884ac2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:24.371231 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a231caa1-b327-428f-b8b6-7f78ef884ac2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:24.371660 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a231caa1-b327-428f-b8b6-7f78ef884ac2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:24.372352 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a231caa1-b327-428f-b8b6-7f78ef884ac2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:24.372822 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a231caa1-b327-428f-b8b6-7f78ef884ac2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:24.373246 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a231caa1-b327-428f-b8b6-7f78ef884ac2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:24.507524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a231caa1-b327-428f-b8b6-7f78ef884ac2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:24.508286 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-6ba39a56-801a-4881-84d0-ab8735b8a9e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:24.508943 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-6ba39a56-801a-4881-84d0-ab8735b8a9e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:24.515141 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a231caa1-b327-428f-b8b6-7f78ef884ac2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.154984 Aug 05 20:04:24.515458 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6ba39a56-801a-4881-84d0-ab8735b8a9e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:24.515708 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 113/213] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:24 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:24.516016 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6ba39a56-801a-4881-84d0-ab8735b8a9e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:24.516525 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6ba39a56-801a-4881-84d0-ab8735b8a9e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:24.517258 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6ba39a56-801a-4881-84d0-ab8735b8a9e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:24.517712 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6ba39a56-801a-4881-84d0-ab8735b8a9e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:24.518135 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6ba39a56-801a-4881-84d0-ab8735b8a9e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:24.647861 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-6ba39a56-801a-4881-84d0-ab8735b8a9e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:24.659858 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-6ba39a56-801a-4881-84d0-ab8735b8a9e8 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1554 microversion: 2.1 time: 0.155296 Aug 05 20:04:24.660467 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 101/214] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:24 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:25.535973 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-c90976b6-a85f-4425-a4e2-cc3b0415ef2a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:25.536660 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-c90976b6-a85f-4425-a4e2-cc3b0415ef2a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:25.543068 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c90976b6-a85f-4425-a4e2-cc3b0415ef2a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:25.543627 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c90976b6-a85f-4425-a4e2-cc3b0415ef2a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:25.544487 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c90976b6-a85f-4425-a4e2-cc3b0415ef2a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:25.544788 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c90976b6-a85f-4425-a4e2-cc3b0415ef2a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:25.545343 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c90976b6-a85f-4425-a4e2-cc3b0415ef2a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:25.545951 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c90976b6-a85f-4425-a4e2-cc3b0415ef2a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:25.682420 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3cb70164-00d0-4e82-9717-e876189f2030 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:25.683089 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-3cb70164-00d0-4e82-9717-e876189f2030 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:25.686914 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-c90976b6-a85f-4425-a4e2-cc3b0415ef2a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:25.689071 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=100 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:25.690194 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3cb70164-00d0-4e82-9717-e876189f2030 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:25.691073 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3cb70164-00d0-4e82-9717-e876189f2030 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:25.691958 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3cb70164-00d0-4e82-9717-e876189f2030 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:25.692825 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3cb70164-00d0-4e82-9717-e876189f2030 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:25.693806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3cb70164-00d0-4e82-9717-e876189f2030 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:25.694320 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3cb70164-00d0-4e82-9717-e876189f2030 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:25.697397 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-c90976b6-a85f-4425-a4e2-cc3b0415ef2a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.164960 Aug 05 20:04:25.698377 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 114/215] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:25 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:25.829381 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3cb70164-00d0-4e82-9717-e876189f2030 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:25.837361 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3cb70164-00d0-4e82-9717-e876189f2030 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1554 microversion: 2.1 time: 0.158915 Aug 05 20:04:25.837926 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 102/216] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:25 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:26.721955 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-5b35b53f-806b-4cbe-b618-4abb1375868d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:26.722567 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-5b35b53f-806b-4cbe-b618-4abb1375868d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:26.728465 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5b35b53f-806b-4cbe-b618-4abb1375868d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:26.728978 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5b35b53f-806b-4cbe-b618-4abb1375868d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:26.729411 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5b35b53f-806b-4cbe-b618-4abb1375868d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:26.730093 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5b35b53f-806b-4cbe-b618-4abb1375868d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:26.730543 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5b35b53f-806b-4cbe-b618-4abb1375868d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:26.730966 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5b35b53f-806b-4cbe-b618-4abb1375868d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:26.861317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-5b35b53f-806b-4cbe-b618-4abb1375868d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:26.861884 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-937ddfe2-f979-4d53-87b8-bc376a7fd0d4 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:26.862653 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-937ddfe2-f979-4d53-87b8-bc376a7fd0d4 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:26.868798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-5b35b53f-806b-4cbe-b618-4abb1375868d tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.151284 Aug 05 20:04:26.868957 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-937ddfe2-f979-4d53-87b8-bc376a7fd0d4 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:26.869367 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 115/217] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:26 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:26.869510 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-937ddfe2-f979-4d53-87b8-bc376a7fd0d4 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:26.869905 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-937ddfe2-f979-4d53-87b8-bc376a7fd0d4 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:26.870664 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-937ddfe2-f979-4d53-87b8-bc376a7fd0d4 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:26.871114 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-937ddfe2-f979-4d53-87b8-bc376a7fd0d4 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:26.871531 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-937ddfe2-f979-4d53-87b8-bc376a7fd0d4 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:27.000876 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-937ddfe2-f979-4d53-87b8-bc376a7fd0d4 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:27.008661 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-937ddfe2-f979-4d53-87b8-bc376a7fd0d4 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1554 microversion: 2.1 time: 0.151242 Aug 05 20:04:27.009221 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 103/218] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:26 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:27.891525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-9f5eee4f-e778-4fd0-93fd-999c26a20aba tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:27.892142 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-9f5eee4f-e778-4fd0-93fd-999c26a20aba tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:27.898751 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9f5eee4f-e778-4fd0-93fd-999c26a20aba tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:27.899242 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9f5eee4f-e778-4fd0-93fd-999c26a20aba tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:27.899694 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9f5eee4f-e778-4fd0-93fd-999c26a20aba tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:27.900379 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9f5eee4f-e778-4fd0-93fd-999c26a20aba tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:27.900870 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9f5eee4f-e778-4fd0-93fd-999c26a20aba tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:27.901295 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9f5eee4f-e778-4fd0-93fd-999c26a20aba tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:28.035593 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-abe7af28-e4fc-4a2c-92b1-0cad4585c1d2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:28.037123 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-abe7af28-e4fc-4a2c-92b1-0cad4585c1d2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:28.045023 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-abe7af28-e4fc-4a2c-92b1-0cad4585c1d2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:28.046301 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-abe7af28-e4fc-4a2c-92b1-0cad4585c1d2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:28.047061 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-abe7af28-e4fc-4a2c-92b1-0cad4585c1d2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:28.047983 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-abe7af28-e4fc-4a2c-92b1-0cad4585c1d2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:28.048499 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-abe7af28-e4fc-4a2c-92b1-0cad4585c1d2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:28.048962 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-abe7af28-e4fc-4a2c-92b1-0cad4585c1d2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:28.050809 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-9f5eee4f-e778-4fd0-93fd-999c26a20aba tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:28.058248 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-9f5eee4f-e778-4fd0-93fd-999c26a20aba tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.171406 Aug 05 20:04:28.059007 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 116/219] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:27 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:28.194280 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-abe7af28-e4fc-4a2c-92b1-0cad4585c1d2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:28.202202 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-abe7af28-e4fc-4a2c-92b1-0cad4585c1d2 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1554 microversion: 2.1 time: 0.175170 Aug 05 20:04:28.202766 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 104/220] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:28 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:29.079658 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-72af9280-d212-43d5-89f7-cc717671229f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:29.080238 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-72af9280-d212-43d5-89f7-cc717671229f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:29.086155 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-72af9280-d212-43d5-89f7-cc717671229f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:29.086674 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-72af9280-d212-43d5-89f7-cc717671229f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:29.087114 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-72af9280-d212-43d5-89f7-cc717671229f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:29.087839 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-72af9280-d212-43d5-89f7-cc717671229f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:29.088292 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-72af9280-d212-43d5-89f7-cc717671229f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:29.088748 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-72af9280-d212-43d5-89f7-cc717671229f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:29.215630 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-72af9280-d212-43d5-89f7-cc717671229f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:29.223692 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-5132c098-b179-41e5-97f8-c538d9f0c064 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:29.224175 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-72af9280-d212-43d5-89f7-cc717671229f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.148794 Aug 05 20:04:29.224463 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 117/221] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:29 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:29.225246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-5132c098-b179-41e5-97f8-c538d9f0c064 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:29.231353 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5132c098-b179-41e5-97f8-c538d9f0c064 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:29.231981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5132c098-b179-41e5-97f8-c538d9f0c064 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:29.232421 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5132c098-b179-41e5-97f8-c538d9f0c064 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:29.233415 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5132c098-b179-41e5-97f8-c538d9f0c064 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:29.233893 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5132c098-b179-41e5-97f8-c538d9f0c064 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:29.234320 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5132c098-b179-41e5-97f8-c538d9f0c064 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:29.548496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-5132c098-b179-41e5-97f8-c538d9f0c064 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:29.556338 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-5132c098-b179-41e5-97f8-c538d9f0c064 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1554 microversion: 2.1 time: 0.336880 Aug 05 20:04:29.556960 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 105/222] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:29 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1554 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:30.049291 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-a075f72a-a59c-4c39-8225-47e20fa07623 req-19e19f51-7093-4852-ae7b-7f8ba8c13bba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03228f62-79c6-41a8-9f85-256350c24645", "name": "network-vif-unplugged", "status": "completed", "tag": "232c6be7-dcbd-4144-841f-4ab31b81702b"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:04:30.058833 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-a075f72a-a59c-4c39-8225-47e20fa07623 req-19e19f51-7093-4852-ae7b-7f8ba8c13bba service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:30.059310 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-a075f72a-a59c-4c39-8225-47e20fa07623 req-19e19f51-7093-4852-ae7b-7f8ba8c13bba service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:30.059739 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-a075f72a-a59c-4c39-8225-47e20fa07623 req-19e19f51-7093-4852-ae7b-7f8ba8c13bba service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:30.071560 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-a075f72a-a59c-4c39-8225-47e20fa07623 req-19e19f51-7093-4852-ae7b-7f8ba8c13bba service nova] Creating event network-vif-unplugged:232c6be7-dcbd-4144-841f-4ab31b81702b for instance 03228f62-79c6-41a8-9f85-256350c24645 on hv-cinder-85221 Aug 05 20:04:30.077638 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-a075f72a-a59c-4c39-8225-47e20fa07623 req-19e19f51-7093-4852-ae7b-7f8ba8c13bba service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031302 Aug 05 20:04:30.078534 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 118/223] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:04:30.244259 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-fa9586e4-805f-4df2-83cc-2cdc7d029570 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:30.244909 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-fa9586e4-805f-4df2-83cc-2cdc7d029570 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:30.252092 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fa9586e4-805f-4df2-83cc-2cdc7d029570 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:30.252598 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fa9586e4-805f-4df2-83cc-2cdc7d029570 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:30.253050 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fa9586e4-805f-4df2-83cc-2cdc7d029570 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:30.253750 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fa9586e4-805f-4df2-83cc-2cdc7d029570 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:30.254208 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fa9586e4-805f-4df2-83cc-2cdc7d029570 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:30.254636 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fa9586e4-805f-4df2-83cc-2cdc7d029570 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:30.521084 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-fa9586e4-805f-4df2-83cc-2cdc7d029570 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:30.530393 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-fa9586e4-805f-4df2-83cc-2cdc7d029570 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.289492 Aug 05 20:04:30.544318 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 106/224] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:30 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:30.578722 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-1f239496-2330-4902-a001-3eeb23d1a61c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:30.579508 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-1f239496-2330-4902-a001-3eeb23d1a61c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:30.585815 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1f239496-2330-4902-a001-3eeb23d1a61c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:30.586297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1f239496-2330-4902-a001-3eeb23d1a61c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:30.586979 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1f239496-2330-4902-a001-3eeb23d1a61c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:30.587668 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1f239496-2330-4902-a001-3eeb23d1a61c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:30.588313 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1f239496-2330-4902-a001-3eeb23d1a61c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:30.588765 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1f239496-2330-4902-a001-3eeb23d1a61c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:30.791889 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-1f239496-2330-4902-a001-3eeb23d1a61c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:30.800887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-1f239496-2330-4902-a001-3eeb23d1a61c tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1554 microversion: 2.1 time: 0.226343 Aug 05 20:04:30.806664 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 119/225] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:30 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1554 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:30.930440 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-feab1755-6ac6-45ef-a73b-d4c778b01318 req-63314d61-b06d-4494-b74d-204099ae514b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03228f62-79c6-41a8-9f85-256350c24645", "name": "network-vif-deleted", "tag": "232c6be7-dcbd-4144-841f-4ab31b81702b"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:04:30.942118 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-feab1755-6ac6-45ef-a73b-d4c778b01318 req-63314d61-b06d-4494-b74d-204099ae514b service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:30.943237 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-feab1755-6ac6-45ef-a73b-d4c778b01318 req-63314d61-b06d-4494-b74d-204099ae514b service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:30.943740 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-feab1755-6ac6-45ef-a73b-d4c778b01318 req-63314d61-b06d-4494-b74d-204099ae514b service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:30.961853 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-feab1755-6ac6-45ef-a73b-d4c778b01318 req-63314d61-b06d-4494-b74d-204099ae514b service nova] Creating event network-vif-deleted:232c6be7-dcbd-4144-841f-4ab31b81702b for instance 03228f62-79c6-41a8-9f85-256350c24645 on hv-cinder-85221 Aug 05 20:04:30.967541 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-feab1755-6ac6-45ef-a73b-d4c778b01318 req-63314d61-b06d-4494-b74d-204099ae514b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040581 Aug 05 20:04:30.968206 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 107/226] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:04:31.552315 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-af4fcab9-da81-423d-adde-6a4487c007fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:31.553028 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-af4fcab9-da81-423d-adde-6a4487c007fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:31.559341 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-af4fcab9-da81-423d-adde-6a4487c007fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:31.559834 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-af4fcab9-da81-423d-adde-6a4487c007fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:31.560274 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-af4fcab9-da81-423d-adde-6a4487c007fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:31.561865 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-af4fcab9-da81-423d-adde-6a4487c007fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:31.562343 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-af4fcab9-da81-423d-adde-6a4487c007fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:31.563261 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-af4fcab9-da81-423d-adde-6a4487c007fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:31.725073 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-af4fcab9-da81-423d-adde-6a4487c007fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:31.733601 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-af4fcab9-da81-423d-adde-6a4487c007fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.185343 Aug 05 20:04:31.736243 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 120/227] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:31 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:31.823117 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-6e2d644d-2a09-494d-be9a-d82284632b19 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:31.823821 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-6e2d644d-2a09-494d-be9a-d82284632b19 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:31.830930 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6e2d644d-2a09-494d-be9a-d82284632b19 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:31.831419 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6e2d644d-2a09-494d-be9a-d82284632b19 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:31.831858 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6e2d644d-2a09-494d-be9a-d82284632b19 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:31.832555 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6e2d644d-2a09-494d-be9a-d82284632b19 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:31.833036 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6e2d644d-2a09-494d-be9a-d82284632b19 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:31.833459 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6e2d644d-2a09-494d-be9a-d82284632b19 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:31.900760 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-6e2d644d-2a09-494d-be9a-d82284632b19 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:31.911495 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-6e2d644d-2a09-494d-be9a-d82284632b19 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1346 microversion: 2.1 time: 0.092566 Aug 05 20:04:31.912083 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 108/228] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:31 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:32.755740 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-d54004cb-f126-4ca2-8cbf-36426825fbbf tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:32.756704 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-d54004cb-f126-4ca2-8cbf-36426825fbbf tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:32.763269 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d54004cb-f126-4ca2-8cbf-36426825fbbf tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:32.765206 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d54004cb-f126-4ca2-8cbf-36426825fbbf tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:32.765731 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d54004cb-f126-4ca2-8cbf-36426825fbbf tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:32.766535 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d54004cb-f126-4ca2-8cbf-36426825fbbf tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:32.767087 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d54004cb-f126-4ca2-8cbf-36426825fbbf tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:32.767559 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d54004cb-f126-4ca2-8cbf-36426825fbbf tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:32.901550 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-d54004cb-f126-4ca2-8cbf-36426825fbbf tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:32.909537 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-d54004cb-f126-4ca2-8cbf-36426825fbbf tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.157974 Aug 05 20:04:32.910128 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 121/229] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:32 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:32.932834 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-24b84c46-d777-470a-a613-60ff65ef6207 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:32.933451 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-24b84c46-d777-470a-a613-60ff65ef6207 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:32.940000 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24b84c46-d777-470a-a613-60ff65ef6207 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:32.940424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24b84c46-d777-470a-a613-60ff65ef6207 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:32.940894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24b84c46-d777-470a-a613-60ff65ef6207 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:32.941582 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24b84c46-d777-470a-a613-60ff65ef6207 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:32.942039 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24b84c46-d777-470a-a613-60ff65ef6207 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:32.942467 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24b84c46-d777-470a-a613-60ff65ef6207 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:32.975501 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24b84c46-d777-470a-a613-60ff65ef6207 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:32.975990 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24b84c46-d777-470a-a613-60ff65ef6207 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:32.976427 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24b84c46-d777-470a-a613-60ff65ef6207 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:32.976921 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.objects.instance [None req-24b84c46-d777-470a-a613-60ff65ef6207 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lazy-loading 'fault' on Instance uuid 03228f62-79c6-41a8-9f85-256350c24645 {{(pid=118191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:04:33.020551 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-24b84c46-d777-470a-a613-60ff65ef6207 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e975aed96648fc9c06f95d49c6f6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb000ac20014d618784b262288bac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:33.028439 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-24b84c46-d777-470a-a613-60ff65ef6207 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 200 len: 1351 microversion: 2.1 time: 0.099525 Aug 05 20:04:33.029039 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 109/230] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:32 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 1351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:33.930664 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-e892107b-a404-4ce8-8518-2fb11fbdd4c6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:33.931433 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-e892107b-a404-4ce8-8518-2fb11fbdd4c6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:33.939183 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e892107b-a404-4ce8-8518-2fb11fbdd4c6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:33.939816 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e892107b-a404-4ce8-8518-2fb11fbdd4c6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:33.940361 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e892107b-a404-4ce8-8518-2fb11fbdd4c6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:33.941229 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e892107b-a404-4ce8-8518-2fb11fbdd4c6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:33.941797 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e892107b-a404-4ce8-8518-2fb11fbdd4c6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:33.942238 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e892107b-a404-4ce8-8518-2fb11fbdd4c6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:34.052468 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-08a751c0-5341-4fc1-b78e-3fdda66f4ee3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:34.053475 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-08a751c0-5341-4fc1-b78e-3fdda66f4ee3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:34.065781 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-08a751c0-5341-4fc1-b78e-3fdda66f4ee3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:34.066402 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-08a751c0-5341-4fc1-b78e-3fdda66f4ee3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:34.066843 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-08a751c0-5341-4fc1-b78e-3fdda66f4ee3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:34.067820 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-08a751c0-5341-4fc1-b78e-3fdda66f4ee3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:34.068489 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-08a751c0-5341-4fc1-b78e-3fdda66f4ee3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:34.069212 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-08a751c0-5341-4fc1-b78e-3fdda66f4ee3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:34.084633 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-08a751c0-5341-4fc1-b78e-3fdda66f4ee3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] HTTP exception thrown: Instance 03228f62-79c6-41a8-9f85-256350c24645 could not be found. Aug 05 20:04:34.088512 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-e892107b-a404-4ce8-8518-2fb11fbdd4c6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:34.089317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-08a751c0-5341-4fc1-b78e-3fdda66f4ee3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Request method failure captured: Aug 05 20:04:34.089317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 HTTP/1.1 Aug 05 20:04:34.089317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:04:34.089317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:04:34.089317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:04:34.089317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:04:34.089317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:04:34.089317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:04:34.089317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:04:34.089317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:04:34.089317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XdpE8ZIGOgScmXQytXlsGPTTE4NOC6LFteDRkbHDGneZ7yBdA-XBoVo63jS2EsOCOthJUBzKZ9AfFSqGVNHK-_brLfIPrzRwkA0g3J7-9WfDc67h-QZgLPOsHq1usbGcNlyv_8OXX-u3US0my59ovswFiWIEnoGIGTuoqSa9saS0Y4 Aug 05 20:04:34.089317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:04:34.089317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:04:34.089317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:04:34.089317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:04:34.089317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:04:34.089317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:04:34.089317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: 2bb000ac20014d618784b262288bac32 Aug 05 20:04:34.089317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-DeleteServersTestJSON-976946083 Aug 05 20:04:34.089317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:04:34.089317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:04:34.090818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2bb000ac20014d618784b262288bac32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2bb000ac20014d618784b262288bac32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2bb000ac20014d618784b262288bac32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2bb000ac20014d618784b262288bac32", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:04:34.090818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-DeleteServersTestJSON-976946083 Aug 05 20:04:34.090818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: 2bb000ac20014d618784b262288bac32 Aug 05 20:04:34.090818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-DeleteServersTestJSON-976946083 Aug 05 20:04:34.090818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-DeleteServersTestJSON-976946083-project Aug 05 20:04:34.090818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:04:34.090818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:04:34.090818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: 83e975aed96648fc9c06f95d49c6f6f9 Aug 05 20:04:34.090818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-DeleteServersTestJSON-976946083-project Aug 05 20:04:34.090818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: > Aug 05 20:04:34.090818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Instance 03228f62-79c6-41a8-9f85-256350c24645 could not be found. Aug 05 20:04:34.090818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'id': '03228f62-79c6-41a8-9f85-256350c24645'} Aug 05 20:04:34.091678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:04:34.091678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:34.091678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:04:34.091678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:04:34.091678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:04:34.091678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:04:34.091678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:04:34.091678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:04:34.091678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:04:34.091678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:04:34.091678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03228f62-79c6-41a8-9f85-256350c24645 could not be found. Aug 05 20:04:34.091678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:04:34.091678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:34.091678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:04:34.091678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:34.091678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:34.091678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:34.091678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:04:34.091678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:04:34.091678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:04:34.093320 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:04:34.093320 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:04:34.093320 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:04:34.093320 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:04:34.093320 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:04:34.093320 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:04:34.093320 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:04:34.093320 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03228f62-79c6-41a8-9f85-256350c24645 could not be found. Aug 05 20:04:34.093320 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:04:34.093320 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:34.093320 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:04:34.093320 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:34.093320 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:34.093320 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:34.093320 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:04:34.093320 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:04:34.093320 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03228f62-79c6-41a8-9f85-256350c24645 could not be found. Aug 05 20:04:34.093320 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:04:34.094464 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-08a751c0-5341-4fc1-b78e-3fdda66f4ee3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Returning 404 to user: Instance 03228f62-79c6-41a8-9f85-256350c24645 could not be found. {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:04:34.094464 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-08a751c0-5341-4fc1-b78e-3fdda66f4ee3 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 404 len: 111 microversion: 2.1 time: 0.042381 Aug 05 20:04:34.095189 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 110/231] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:34 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:04:34.102286 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-e892107b-a404-4ce8-8518-2fb11fbdd4c6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.175339 Aug 05 20:04:34.102964 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 122/232] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:33 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:34.207977 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7e1af1c4-59b3-43c5-9147-96ecf3463549 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:34.210261 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-7e1af1c4-59b3-43c5-9147-96ecf3463549 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:34.216109 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7e1af1c4-59b3-43c5-9147-96ecf3463549 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:34.216614 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7e1af1c4-59b3-43c5-9147-96ecf3463549 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:34.217781 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7e1af1c4-59b3-43c5-9147-96ecf3463549 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:34.218567 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7e1af1c4-59b3-43c5-9147-96ecf3463549 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:34.219023 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7e1af1c4-59b3-43c5-9147-96ecf3463549 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:34.219451 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7e1af1c4-59b3-43c5-9147-96ecf3463549 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:34.233416 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-7e1af1c4-59b3-43c5-9147-96ecf3463549 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] HTTP exception thrown: Instance 03228f62-79c6-41a8-9f85-256350c24645 could not be found. Aug 05 20:04:34.235030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7e1af1c4-59b3-43c5-9147-96ecf3463549 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Request method failure captured: Aug 05 20:04:34.235030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645/os-volume_attachments HTTP/1.1 Aug 05 20:04:34.235030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:04:34.235030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:04:34.235030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:04:34.235030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:04:34.235030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:04:34.235030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:04:34.235030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:04:34.235030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:04:34.235030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XdpE8ZIGOgScmXQytXlsGPTTE4NOC6LFteDRkbHDGneZ7yBdA-XBoVo63jS2EsOCOthJUBzKZ9AfFSqGVNHK-_brLfIPrzRwkA0g3J7-9WfDc67h-QZgLPOsHq1usbGcNlyv_8OXX-u3US0my59ovswFiWIEnoGIGTuoqSa9saS0Y4 Aug 05 20:04:34.235030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:04:34.235030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:04:34.235030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:04:34.235030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:04:34.235030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:04:34.235030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:04:34.235030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: 2bb000ac20014d618784b262288bac32 Aug 05 20:04:34.235030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-DeleteServersTestJSON-976946083 Aug 05 20:04:34.235030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:04:34.235030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:04:34.236374 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2bb000ac20014d618784b262288bac32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2bb000ac20014d618784b262288bac32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2bb000ac20014d618784b262288bac32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2bb000ac20014d618784b262288bac32", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:04:34.236374 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-DeleteServersTestJSON-976946083 Aug 05 20:04:34.236374 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: 2bb000ac20014d618784b262288bac32 Aug 05 20:04:34.236374 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-DeleteServersTestJSON-976946083 Aug 05 20:04:34.236374 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-DeleteServersTestJSON-976946083-project Aug 05 20:04:34.236374 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:04:34.236374 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:04:34.236374 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: 83e975aed96648fc9c06f95d49c6f6f9 Aug 05 20:04:34.236374 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-DeleteServersTestJSON-976946083-project Aug 05 20:04:34.236374 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: > Aug 05 20:04:34.236374 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Instance 03228f62-79c6-41a8-9f85-256350c24645 could not be found. Aug 05 20:04:34.236374 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'server_id': '03228f62-79c6-41a8-9f85-256350c24645'} Aug 05 20:04:34.237238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:04:34.237238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:34.237238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:04:34.237238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:04:34.237238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:04:34.237238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:04:34.237238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:04:34.237238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:04:34.237238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:04:34.237238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:04:34.237238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03228f62-79c6-41a8-9f85-256350c24645 could not be found. Aug 05 20:04:34.237238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:04:34.237238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:34.237238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:04:34.237238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:34.237238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:34.237238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:34.237238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:04:34.237238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:04:34.237238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:04:34.238599 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:04:34.238599 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 05 20:04:34.238599 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:04:34.238599 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 05 20:04:34.238599 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:04:34.238599 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 05 20:04:34.238599 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 05 20:04:34.238599 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:04:34.238599 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:04:34.238599 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03228f62-79c6-41a8-9f85-256350c24645 could not be found. Aug 05 20:04:34.238599 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:04:34.238599 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:34.238599 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:04:34.238599 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:34.238599 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:34.238599 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:34.238599 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:04:34.238599 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:04:34.238599 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03228f62-79c6-41a8-9f85-256350c24645 could not be found. Aug 05 20:04:34.238599 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:04:34.239825 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7e1af1c4-59b3-43c5-9147-96ecf3463549 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Returning 404 to user: Instance 03228f62-79c6-41a8-9f85-256350c24645 could not be found. {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:04:34.239825 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-7e1af1c4-59b3-43c5-9147-96ecf3463549 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032458 Aug 05 20:04:34.240425 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 111/233] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Aug 5 20:04:34 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 20:04:35.128052 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-de5ba693-2ac5-4510-bee3-1ed9da242dc7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:35.128697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-de5ba693-2ac5-4510-bee3-1ed9da242dc7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:35.134669 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de5ba693-2ac5-4510-bee3-1ed9da242dc7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:35.135146 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de5ba693-2ac5-4510-bee3-1ed9da242dc7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:35.135575 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de5ba693-2ac5-4510-bee3-1ed9da242dc7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:35.136255 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de5ba693-2ac5-4510-bee3-1ed9da242dc7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:35.136737 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de5ba693-2ac5-4510-bee3-1ed9da242dc7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:35.137159 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de5ba693-2ac5-4510-bee3-1ed9da242dc7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:35.269729 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-de5ba693-2ac5-4510-bee3-1ed9da242dc7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:35.277118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-de5ba693-2ac5-4510-bee3-1ed9da242dc7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.152863 Aug 05 20:04:35.277693 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 123/234] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:35 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:36.298079 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-b546bb0d-31d9-43da-9c3d-8b1a77445eee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:36.298613 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-b546bb0d-31d9-43da-9c3d-8b1a77445eee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:36.305136 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b546bb0d-31d9-43da-9c3d-8b1a77445eee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:36.305625 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b546bb0d-31d9-43da-9c3d-8b1a77445eee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:36.306063 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b546bb0d-31d9-43da-9c3d-8b1a77445eee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:36.306757 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b546bb0d-31d9-43da-9c3d-8b1a77445eee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:36.307211 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b546bb0d-31d9-43da-9c3d-8b1a77445eee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:36.307637 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b546bb0d-31d9-43da-9c3d-8b1a77445eee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:36.436800 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-b546bb0d-31d9-43da-9c3d-8b1a77445eee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:36.444232 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-b546bb0d-31d9-43da-9c3d-8b1a77445eee tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.150857 Aug 05 20:04:36.444843 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 112/235] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:36 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:37.465028 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-86d28b08-840b-46b2-ab7c-b3d47842ab56 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:37.465542 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-86d28b08-840b-46b2-ab7c-b3d47842ab56 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:37.472248 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-86d28b08-840b-46b2-ab7c-b3d47842ab56 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:37.472896 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-86d28b08-840b-46b2-ab7c-b3d47842ab56 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:37.473372 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-86d28b08-840b-46b2-ab7c-b3d47842ab56 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:37.474079 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-86d28b08-840b-46b2-ab7c-b3d47842ab56 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:37.474529 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-86d28b08-840b-46b2-ab7c-b3d47842ab56 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:37.474979 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-86d28b08-840b-46b2-ab7c-b3d47842ab56 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:37.615058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-86d28b08-840b-46b2-ab7c-b3d47842ab56 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:37.622463 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-86d28b08-840b-46b2-ab7c-b3d47842ab56 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.161317 Aug 05 20:04:37.623115 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 124/236] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:37 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:38.643360 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a6ca736b-cb5a-4b62-ba84-f05c4a6899e0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:38.644315 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-a6ca736b-cb5a-4b62-ba84-f05c4a6899e0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:38.650745 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a6ca736b-cb5a-4b62-ba84-f05c4a6899e0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:38.651497 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a6ca736b-cb5a-4b62-ba84-f05c4a6899e0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:38.652183 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a6ca736b-cb5a-4b62-ba84-f05c4a6899e0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:38.653238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a6ca736b-cb5a-4b62-ba84-f05c4a6899e0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:38.654015 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a6ca736b-cb5a-4b62-ba84-f05c4a6899e0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:38.655318 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a6ca736b-cb5a-4b62-ba84-f05c4a6899e0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:38.800892 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a6ca736b-cb5a-4b62-ba84-f05c4a6899e0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:38.808618 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-a6ca736b-cb5a-4b62-ba84-f05c4a6899e0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.169392 Aug 05 20:04:38.809189 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 113/237] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:38 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:39.830608 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-1339633b-ed28-4dc8-9fd2-7b84856d73fa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:39.831259 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-1339633b-ed28-4dc8-9fd2-7b84856d73fa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:39.837275 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1339633b-ed28-4dc8-9fd2-7b84856d73fa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:39.837757 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1339633b-ed28-4dc8-9fd2-7b84856d73fa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:39.838193 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1339633b-ed28-4dc8-9fd2-7b84856d73fa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:39.838884 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1339633b-ed28-4dc8-9fd2-7b84856d73fa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:39.839385 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1339633b-ed28-4dc8-9fd2-7b84856d73fa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:39.839810 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1339633b-ed28-4dc8-9fd2-7b84856d73fa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:39.970696 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-1339633b-ed28-4dc8-9fd2-7b84856d73fa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:39.979195 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-1339633b-ed28-4dc8-9fd2-7b84856d73fa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.153746 Aug 05 20:04:39.979876 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 125/238] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:39 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:40.780404 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-ff5c0d2b-f110-45fe-add0-6d9b949b4870 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:40.780404 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-ff5c0d2b-f110-45fe-add0-6d9b949b4870 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:40.784510 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ff5c0d2b-f110-45fe-add0-6d9b949b4870 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:40.785040 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ff5c0d2b-f110-45fe-add0-6d9b949b4870 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:40.785459 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ff5c0d2b-f110-45fe-add0-6d9b949b4870 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:40.786150 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ff5c0d2b-f110-45fe-add0-6d9b949b4870 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:40.786915 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ff5c0d2b-f110-45fe-add0-6d9b949b4870 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:40.787325 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ff5c0d2b-f110-45fe-add0-6d9b949b4870 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:40.790251 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=100 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:40.803240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-ff5c0d2b-f110-45fe-add0-6d9b949b4870 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] HTTP exception thrown: Instance 03228f62-79c6-41a8-9f85-256350c24645 could not be found. Aug 05 20:04:40.804837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-ff5c0d2b-f110-45fe-add0-6d9b949b4870 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Request method failure captured: Aug 05 20:04:40.804837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: DELETE /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 HTTP/1.1 Aug 05 20:04:40.804837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:04:40.804837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:04:40.804837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:04:40.804837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:04:40.804837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:04:40.804837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:04:40.804837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:04:40.804837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:04:40.804837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XdpE8ZIGOgScmXQytXlsGPTTE4NOC6LFteDRkbHDGneZ7yBdA-XBoVo63jS2EsOCOthJUBzKZ9AfFSqGVNHK-_brLfIPrzRwkA0g3J7-9WfDc67h-QZgLPOsHq1usbGcNlyv_8OXX-u3US0my59ovswFiWIEnoGIGTuoqSa9saS0Y4 Aug 05 20:04:40.804837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:04:40.804837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:04:40.804837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:04:40.804837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:04:40.804837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:04:40.804837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:04:40.804837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: 2bb000ac20014d618784b262288bac32 Aug 05 20:04:40.804837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-DeleteServersTestJSON-976946083 Aug 05 20:04:40.804837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:04:40.804837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:04:40.806123 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2bb000ac20014d618784b262288bac32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2bb000ac20014d618784b262288bac32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2bb000ac20014d618784b262288bac32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2bb000ac20014d618784b262288bac32", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:04:40.806123 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-DeleteServersTestJSON-976946083 Aug 05 20:04:40.806123 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: 2bb000ac20014d618784b262288bac32 Aug 05 20:04:40.806123 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-DeleteServersTestJSON-976946083 Aug 05 20:04:40.806123 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-DeleteServersTestJSON-976946083-project Aug 05 20:04:40.806123 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:04:40.806123 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:04:40.806123 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: 83e975aed96648fc9c06f95d49c6f6f9 Aug 05 20:04:40.806123 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-DeleteServersTestJSON-976946083-project Aug 05 20:04:40.806123 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: > Aug 05 20:04:40.806123 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Instance 03228f62-79c6-41a8-9f85-256350c24645 could not be found. Aug 05 20:04:40.806123 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'id': '03228f62-79c6-41a8-9f85-256350c24645'} Aug 05 20:04:40.806881 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:04:40.806881 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:40.806881 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:04:40.806881 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:04:40.806881 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:04:40.806881 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:04:40.806881 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:04:40.806881 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:04:40.806881 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:04:40.806881 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:04:40.806881 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03228f62-79c6-41a8-9f85-256350c24645 could not be found. Aug 05 20:04:40.806881 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:04:40.806881 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:40.806881 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:04:40.806881 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:40.806881 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:40.806881 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:40.806881 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:04:40.806881 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:04:40.806881 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:04:40.808559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:04:40.808559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:04:40.808559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:04:40.808559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:04:40.808559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:04:40.808559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:04:40.808559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:04:40.808559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:04:40.808559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:04:40.808559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03228f62-79c6-41a8-9f85-256350c24645 could not be found. Aug 05 20:04:40.808559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:04:40.808559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:40.808559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:04:40.808559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:40.808559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:40.808559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:40.808559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:04:40.808559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:04:40.808559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03228f62-79c6-41a8-9f85-256350c24645 could not be found. Aug 05 20:04:40.808559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:04:40.811988 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-ff5c0d2b-f110-45fe-add0-6d9b949b4870 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Returning 404 to user: Instance 03228f62-79c6-41a8-9f85-256350c24645 could not be found. {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:04:40.811988 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-ff5c0d2b-f110-45fe-add0-6d9b949b4870 tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "DELETE /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 404 len: 111 microversion: 2.1 time: 0.034886 Aug 05 20:04:40.811988 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 114/239] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:04:40 2022] DELETE /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:04:40.815005 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ba06783f-7c3e-44be-9afa-893ef35ec97b tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:40.815622 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-ba06783f-7c3e-44be-9afa-893ef35ec97b tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] [instance: 03228f62-79c6-41a8-9f85-256350c24645] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:40.821650 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ba06783f-7c3e-44be-9afa-893ef35ec97b tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:40.822253 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ba06783f-7c3e-44be-9afa-893ef35ec97b tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:40.822551 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ba06783f-7c3e-44be-9afa-893ef35ec97b tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:40.823362 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ba06783f-7c3e-44be-9afa-893ef35ec97b tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:40.823693 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ba06783f-7c3e-44be-9afa-893ef35ec97b tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:40.824291 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ba06783f-7c3e-44be-9afa-893ef35ec97b tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:40.840555 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-ba06783f-7c3e-44be-9afa-893ef35ec97b tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] HTTP exception thrown: Instance 03228f62-79c6-41a8-9f85-256350c24645 could not be found. Aug 05 20:04:40.846072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ba06783f-7c3e-44be-9afa-893ef35ec97b tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Request method failure captured: Aug 05 20:04:40.846072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 HTTP/1.1 Aug 05 20:04:40.846072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:04:40.846072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:04:40.846072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:04:40.846072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 0 Aug 05 20:04:40.846072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:04:40.846072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:04:40.846072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:04:40.846072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:04:40.846072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XdpE8ZIGOgScmXQytXlsGPTTE4NOC6LFteDRkbHDGneZ7yBdA-XBoVo63jS2EsOCOthJUBzKZ9AfFSqGVNHK-_brLfIPrzRwkA0g3J7-9WfDc67h-QZgLPOsHq1usbGcNlyv_8OXX-u3US0my59ovswFiWIEnoGIGTuoqSa9saS0Y4 Aug 05 20:04:40.846072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:04:40.846072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:04:40.846072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:04:40.846072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:04:40.846072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:04:40.846072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:04:40.846072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: 2bb000ac20014d618784b262288bac32 Aug 05 20:04:40.846072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-DeleteServersTestJSON-976946083 Aug 05 20:04:40.846072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:04:40.846072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:04:40.847579 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2bb000ac20014d618784b262288bac32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2bb000ac20014d618784b262288bac32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2bb000ac20014d618784b262288bac32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2bb000ac20014d618784b262288bac32", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:04:40.847579 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-DeleteServersTestJSON-976946083 Aug 05 20:04:40.847579 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: 2bb000ac20014d618784b262288bac32 Aug 05 20:04:40.847579 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-DeleteServersTestJSON-976946083 Aug 05 20:04:40.847579 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-DeleteServersTestJSON-976946083-project Aug 05 20:04:40.847579 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:04:40.847579 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:04:40.847579 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: 83e975aed96648fc9c06f95d49c6f6f9 Aug 05 20:04:40.847579 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-DeleteServersTestJSON-976946083-project Aug 05 20:04:40.847579 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: > Aug 05 20:04:40.847579 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Instance 03228f62-79c6-41a8-9f85-256350c24645 could not be found. Aug 05 20:04:40.847579 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'id': '03228f62-79c6-41a8-9f85-256350c24645'} Aug 05 20:04:40.848438 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:04:40.848438 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:40.848438 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:04:40.848438 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:04:40.848438 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:04:40.848438 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:04:40.848438 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:04:40.848438 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:04:40.848438 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:04:40.848438 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:04:40.848438 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03228f62-79c6-41a8-9f85-256350c24645 could not be found. Aug 05 20:04:40.848438 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:04:40.848438 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:40.848438 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:04:40.848438 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:40.848438 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:40.848438 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:40.848438 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:04:40.848438 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:04:40.848438 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:04:40.850121 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:04:40.850121 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:04:40.850121 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:04:40.850121 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:04:40.850121 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:04:40.850121 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:04:40.850121 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:04:40.850121 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03228f62-79c6-41a8-9f85-256350c24645 could not be found. Aug 05 20:04:40.850121 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:04:40.850121 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:04:40.850121 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:04:40.850121 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:04:40.850121 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:04:40.850121 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:04:40.850121 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:04:40.850121 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:04:40.850121 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03228f62-79c6-41a8-9f85-256350c24645 could not be found. Aug 05 20:04:40.850121 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:04:40.851820 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ba06783f-7c3e-44be-9afa-893ef35ec97b tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] Returning 404 to user: Instance 03228f62-79c6-41a8-9f85-256350c24645 could not be found. {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:04:40.851820 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-ba06783f-7c3e-44be-9afa-893ef35ec97b tempest-DeleteServersTestJSON-976946083 tempest-DeleteServersTestJSON-976946083-project] 10.222.0.39 "GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645" status: 404 len: 111 microversion: 2.1 time: 0.036460 Aug 05 20:04:40.851820 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 126/240] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:40 2022] GET /compute/v2.1/servers/03228f62-79c6-41a8-9f85-256350c24645 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:04:41.002619 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-b042ee1d-cc3f-496f-af2f-4b6050fb2640 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:41.003386 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-b042ee1d-cc3f-496f-af2f-4b6050fb2640 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:41.014302 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b042ee1d-cc3f-496f-af2f-4b6050fb2640 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:41.014804 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b042ee1d-cc3f-496f-af2f-4b6050fb2640 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:41.015422 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b042ee1d-cc3f-496f-af2f-4b6050fb2640 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:41.016301 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b042ee1d-cc3f-496f-af2f-4b6050fb2640 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:41.016789 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b042ee1d-cc3f-496f-af2f-4b6050fb2640 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:41.017384 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b042ee1d-cc3f-496f-af2f-4b6050fb2640 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:41.220939 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-b042ee1d-cc3f-496f-af2f-4b6050fb2640 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:41.231063 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-b042ee1d-cc3f-496f-af2f-4b6050fb2640 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.233442 Aug 05 20:04:41.231708 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 115/241] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:40 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:42.253735 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-284e086c-23f1-44e8-833d-b44f0091aa72 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:42.254407 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-284e086c-23f1-44e8-833d-b44f0091aa72 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:42.270658 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-284e086c-23f1-44e8-833d-b44f0091aa72 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:42.271155 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-284e086c-23f1-44e8-833d-b44f0091aa72 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:42.271601 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-284e086c-23f1-44e8-833d-b44f0091aa72 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:42.272289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-284e086c-23f1-44e8-833d-b44f0091aa72 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:42.272778 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-284e086c-23f1-44e8-833d-b44f0091aa72 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:42.273202 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-284e086c-23f1-44e8-833d-b44f0091aa72 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:42.497214 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-284e086c-23f1-44e8-833d-b44f0091aa72 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:42.514049 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-284e086c-23f1-44e8-833d-b44f0091aa72 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1522 microversion: 2.1 time: 0.261759 Aug 05 20:04:42.515508 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 127/242] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:42 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:43.536328 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-36704966-5b4a-4bd5-971c-1c040d9dc3cb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:43.536984 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-36704966-5b4a-4bd5-971c-1c040d9dc3cb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:43.545812 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-36704966-5b4a-4bd5-971c-1c040d9dc3cb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:43.547645 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-36704966-5b4a-4bd5-971c-1c040d9dc3cb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:43.548470 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-36704966-5b4a-4bd5-971c-1c040d9dc3cb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:43.552731 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-36704966-5b4a-4bd5-971c-1c040d9dc3cb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:43.553804 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-36704966-5b4a-4bd5-971c-1c040d9dc3cb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:43.554511 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-36704966-5b4a-4bd5-971c-1c040d9dc3cb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:43.769364 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-36704966-5b4a-4bd5-971c-1c040d9dc3cb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:43.781826 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-36704966-5b4a-4bd5-971c-1c040d9dc3cb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1502 microversion: 2.1 time: 0.249457 Aug 05 20:04:43.783107 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 116/243] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:43 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1502 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:43.802536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-d28e1904-e616-4323-a21d-ed862163eece tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:43.803196 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-d28e1904-e616-4323-a21d-ed862163eece tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:43.812412 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d28e1904-e616-4323-a21d-ed862163eece tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:43.813238 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d28e1904-e616-4323-a21d-ed862163eece tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:43.813673 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d28e1904-e616-4323-a21d-ed862163eece tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:43.814450 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d28e1904-e616-4323-a21d-ed862163eece tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:43.815119 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d28e1904-e616-4323-a21d-ed862163eece tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:43.815542 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d28e1904-e616-4323-a21d-ed862163eece tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:44.114490 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-d28e1904-e616-4323-a21d-ed862163eece tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:44.124731 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-d28e1904-e616-4323-a21d-ed862163eece tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1516 microversion: 2.1 time: 0.326052 Aug 05 20:04:44.125558 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 128/244] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:43 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1516 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:47.010481 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-2add2938-ffab-4553-a91b-a24a402e204e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:04:47.012711 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-2add2938-ffab-4553-a91b-a24a402e204e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:47.015851 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=54 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:47.021937 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2add2938-ffab-4553-a91b-a24a402e204e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:47.022708 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2add2938-ffab-4553-a91b-a24a402e204e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:47.023449 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2add2938-ffab-4553-a91b-a24a402e204e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:47.024362 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2add2938-ffab-4553-a91b-a24a402e204e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:47.025157 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2add2938-ffab-4553-a91b-a24a402e204e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:47.025834 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2add2938-ffab-4553-a91b-a24a402e204e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:47.056698 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.objects.instance [None req-2add2938-ffab-4553-a91b-a24a402e204e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lazy-loading 'flavor' on Instance uuid eaafcd0b-5f14-4973-8cc5-274510846bc2 {{(pid=118191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:04:47.190411 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-2add2938-ffab-4553-a91b-a24a402e204e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "POST /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2/action" status: 200 len: 32 microversion: 2.1 time: 0.183963 Aug 05 20:04:47.191283 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 117/245] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Aug 5 20:04:47 2022] POST /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2/action => generated 32 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:04:47.200831 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-822f1881-cd6c-46af-9953-7560c9a2bb28 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:47.201493 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-822f1881-cd6c-46af-9953-7560c9a2bb28 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:47.203475 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=50 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:47.208604 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-822f1881-cd6c-46af-9953-7560c9a2bb28 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:47.209285 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-822f1881-cd6c-46af-9953-7560c9a2bb28 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:47.209941 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-822f1881-cd6c-46af-9953-7560c9a2bb28 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:47.210646 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-822f1881-cd6c-46af-9953-7560c9a2bb28 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:47.211108 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-822f1881-cd6c-46af-9953-7560c9a2bb28 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:47.211527 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-822f1881-cd6c-46af-9953-7560c9a2bb28 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:47.402728 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-822f1881-cd6c-46af-9953-7560c9a2bb28 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:47.416513 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-822f1881-cd6c-46af-9953-7560c9a2bb28 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.219429 Aug 05 20:04:47.417307 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 129/246] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:47 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:48.441101 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-37148c43-9e65-4eb4-94f0-fce329cc5e4c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:48.441802 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-37148c43-9e65-4eb4-94f0-fce329cc5e4c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:48.452267 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-37148c43-9e65-4eb4-94f0-fce329cc5e4c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:48.452910 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-37148c43-9e65-4eb4-94f0-fce329cc5e4c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:48.453648 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-37148c43-9e65-4eb4-94f0-fce329cc5e4c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:48.454361 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-37148c43-9e65-4eb4-94f0-fce329cc5e4c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:48.454820 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-37148c43-9e65-4eb4-94f0-fce329cc5e4c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:48.455242 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-37148c43-9e65-4eb4-94f0-fce329cc5e4c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:48.622361 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-37148c43-9e65-4eb4-94f0-fce329cc5e4c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:48.633963 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-37148c43-9e65-4eb4-94f0-fce329cc5e4c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.197884 Aug 05 20:04:48.635622 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 118/247] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:48 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:49.657197 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-6115383e-3124-4c0b-8bd0-9c26b3cb5704 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:49.657829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-6115383e-3124-4c0b-8bd0-9c26b3cb5704 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:49.664081 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6115383e-3124-4c0b-8bd0-9c26b3cb5704 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:49.664872 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6115383e-3124-4c0b-8bd0-9c26b3cb5704 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:49.665381 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6115383e-3124-4c0b-8bd0-9c26b3cb5704 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:49.666089 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6115383e-3124-4c0b-8bd0-9c26b3cb5704 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:49.666698 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6115383e-3124-4c0b-8bd0-9c26b3cb5704 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:49.667131 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6115383e-3124-4c0b-8bd0-9c26b3cb5704 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:49.897360 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-6115383e-3124-4c0b-8bd0-9c26b3cb5704 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:49.905472 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-6115383e-3124-4c0b-8bd0-9c26b3cb5704 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.253555 Aug 05 20:04:49.906762 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 130/248] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:49 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:50.931717 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-2af3dd8c-3324-4a1c-9604-741ece1dd223 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:50.935882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-2af3dd8c-3324-4a1c-9604-741ece1dd223 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:50.943886 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2af3dd8c-3324-4a1c-9604-741ece1dd223 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:50.944972 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2af3dd8c-3324-4a1c-9604-741ece1dd223 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:50.945790 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2af3dd8c-3324-4a1c-9604-741ece1dd223 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:50.948186 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2af3dd8c-3324-4a1c-9604-741ece1dd223 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:50.948943 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2af3dd8c-3324-4a1c-9604-741ece1dd223 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:50.951217 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2af3dd8c-3324-4a1c-9604-741ece1dd223 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:51.335638 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-2af3dd8c-3324-4a1c-9604-741ece1dd223 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:51.346408 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-2af3dd8c-3324-4a1c-9604-741ece1dd223 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.418556 Aug 05 20:04:51.347314 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 119/249] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:50 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:52.368276 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-369c669c-327d-4281-96a4-882f88b8161b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:52.369337 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-369c669c-327d-4281-96a4-882f88b8161b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:52.391550 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-369c669c-327d-4281-96a4-882f88b8161b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:52.392051 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-369c669c-327d-4281-96a4-882f88b8161b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:52.397094 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-369c669c-327d-4281-96a4-882f88b8161b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:52.400093 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-369c669c-327d-4281-96a4-882f88b8161b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:52.400609 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-369c669c-327d-4281-96a4-882f88b8161b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:52.401145 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-369c669c-327d-4281-96a4-882f88b8161b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:52.573281 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-369c669c-327d-4281-96a4-882f88b8161b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:52.584530 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-369c669c-327d-4281-96a4-882f88b8161b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.221633 Aug 05 20:04:52.593125 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 131/250] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:52 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:53.609617 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-1b192d88-32bc-4343-b1ce-fd9983f17bc4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:53.610238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-1b192d88-32bc-4343-b1ce-fd9983f17bc4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:53.617238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1b192d88-32bc-4343-b1ce-fd9983f17bc4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:53.617667 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1b192d88-32bc-4343-b1ce-fd9983f17bc4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:53.618111 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1b192d88-32bc-4343-b1ce-fd9983f17bc4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:53.618805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1b192d88-32bc-4343-b1ce-fd9983f17bc4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:53.619540 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1b192d88-32bc-4343-b1ce-fd9983f17bc4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:53.620124 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1b192d88-32bc-4343-b1ce-fd9983f17bc4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:53.779987 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-1b192d88-32bc-4343-b1ce-fd9983f17bc4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:53.781427 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-1b192d88-32bc-4343-b1ce-fd9983f17bc4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.176760 Aug 05 20:04:53.782003 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 120/251] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:53 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:53.909884 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-286e8546-cc31-494b-a6d4-daf8e0830b28 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Action: 'create', calling method: .version_select at 0x7fe3e47044c0>, body: {"keypair": {"name": "tempest-keypair-1390974380", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqZqZsJQ0OM6S0m/637Wmxxhhw+RuxBG+tAvts9ppJ8aJFj9y1obwpFKtTYU00gdXmJ0hwKPR/TpzXUUt1QKPgHxddfKYJHMJJEzeDMS9oUWWjoFtVRZRJaMW0iVGIYjA=="}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:04:53.926720 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-286e8546-cc31-494b-a6d4-daf8e0830b28 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Getting quotas for project aa4789b47e0f47b0acd1cc4919593c33. Resources: {'key_pairs'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:04:53.930736 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-286e8546-cc31-494b-a6d4-daf8e0830b28 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Getting quotas for user 160c88a7ba0144d4b1bc953767b12bb7 and project aa4789b47e0f47b0acd1cc4919593c33. Resources: {'key_pairs'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:04:53.954101 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-286e8546-cc31-494b-a6d4-daf8e0830b28 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.173025 Aug 05 20:04:53.954727 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 132/252] 10.222.0.39 () {62 vars in 1200 bytes} [Fri Aug 5 20:04:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 174 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 05 20:04:54.817446 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-ba37ef6c-045b-4e34-a0c2-743eeb7fdab5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:54.818078 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-ba37ef6c-045b-4e34-a0c2-743eeb7fdab5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:54.825563 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ba37ef6c-045b-4e34-a0c2-743eeb7fdab5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:54.826145 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ba37ef6c-045b-4e34-a0c2-743eeb7fdab5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:54.826584 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ba37ef6c-045b-4e34-a0c2-743eeb7fdab5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:54.827672 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ba37ef6c-045b-4e34-a0c2-743eeb7fdab5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:54.828440 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ba37ef6c-045b-4e34-a0c2-743eeb7fdab5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:54.829244 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ba37ef6c-045b-4e34-a0c2-743eeb7fdab5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:55.109707 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-ba37ef6c-045b-4e34-a0c2-743eeb7fdab5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:55.132202 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-ba37ef6c-045b-4e34-a0c2-743eeb7fdab5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.333477 Aug 05 20:04:55.145645 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 121/253] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:54 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:55.891261 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-fed8ceb2-a7c4-45bd-917b-2cb764d6bc53 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2065293840", "imageRef": "c148255e-9574-4d10-b9bb-13c9411eda77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "667c5e25-02e4-496c-8462-d182e3d7b511"}], "security_groups": [{"name": "tempest-securitygroup--1915681865"}], "key_name": "tempest-keypair-1390974380", "user_data": "}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:04:55.998049 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.network.neutron [None req-fed8ceb2-a7c4-45bd-917b-2cb764d6bc53 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] validate_networks() for [('667c5e25-02e4-496c-8462-d182e3d7b511', None, None, None, None, None)] {{(pid=118192) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:04:56.155703 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f984af14-2dd4-40cb-90d2-3efd4ada4733 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:56.157246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f984af14-2dd4-40cb-90d2-3efd4ada4733 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:56.163972 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f984af14-2dd4-40cb-90d2-3efd4ada4733 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:56.164728 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f984af14-2dd4-40cb-90d2-3efd4ada4733 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:56.165384 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f984af14-2dd4-40cb-90d2-3efd4ada4733 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:56.166253 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f984af14-2dd4-40cb-90d2-3efd4ada4733 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:56.167005 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f984af14-2dd4-40cb-90d2-3efd4ada4733 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:56.167628 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f984af14-2dd4-40cb-90d2-3efd4ada4733 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:56.400016 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f984af14-2dd4-40cb-90d2-3efd4ada4733 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:56.408243 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f984af14-2dd4-40cb-90d2-3efd4ada4733 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.256842 Aug 05 20:04:56.409177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 122/254] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:56 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:04:56.479391 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-fed8ceb2-a7c4-45bd-917b-2cb764d6bc53 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Flavor limits 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:04:56.479810 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-fed8ceb2-a7c4-45bd-917b-2cb764d6bc53 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Image limits 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:04:56.480282 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-fed8ceb2-a7c4-45bd-917b-2cb764d6bc53 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Flavor pref 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:04:56.480731 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-fed8ceb2-a7c4-45bd-917b-2cb764d6bc53 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Image pref 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:04:56.481751 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-fed8ceb2-a7c4-45bd-917b-2cb764d6bc53 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:04:56.491585 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fed8ceb2-a7c4-45bd-917b-2cb764d6bc53 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:56.492067 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fed8ceb2-a7c4-45bd-917b-2cb764d6bc53 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:56.492495 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fed8ceb2-a7c4-45bd-917b-2cb764d6bc53 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:56.493251 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fed8ceb2-a7c4-45bd-917b-2cb764d6bc53 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:56.493698 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fed8ceb2-a7c4-45bd-917b-2cb764d6bc53 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:56.494120 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fed8ceb2-a7c4-45bd-917b-2cb764d6bc53 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:56.503767 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=96 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:04:56.515939 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-fed8ceb2-a7c4-45bd-917b-2cb764d6bc53 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Getting quotas for project aa4789b47e0f47b0acd1cc4919593c33. Resources: {'cores', 'ram', 'instances'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:04:56.520461 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-fed8ceb2-a7c4-45bd-917b-2cb764d6bc53 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Getting quotas for user 160c88a7ba0144d4b1bc953767b12bb7 and project aa4789b47e0f47b0acd1cc4919593c33. Resources: {'cores', 'ram', 'instances'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:04:56.531696 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-fed8ceb2-a7c4-45bd-917b-2cb764d6bc53 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Going to run 1 instances... {{(pid=118192) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:04:56.534008 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-fed8ceb2-a7c4-45bd-917b-2cb764d6bc53 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c148255e-9574-4d10-b9bb-13c9411eda77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:04:56.580360 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-fed8ceb2-a7c4-45bd-917b-2cb764d6bc53 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.693874 Aug 05 20:04:56.581408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 133/255] 10.222.0.39 () {62 vars in 1188 bytes} [Fri Aug 5 20:04:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 05 20:04:56.592699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-be1e191f-816d-437b-9082-8c1b4684d32f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:56.593391 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-be1e191f-816d-437b-9082-8c1b4684d32f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:56.649914 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-be1e191f-816d-437b-9082-8c1b4684d32f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:56.658103 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-be1e191f-816d-437b-9082-8c1b4684d32f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:56.659604 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-be1e191f-816d-437b-9082-8c1b4684d32f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:56.660746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-be1e191f-816d-437b-9082-8c1b4684d32f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1282 microversion: 2.20 time: 0.072660 Aug 05 20:04:56.661319 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 123/256] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:04:56 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1282 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:04:57.429676 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-65460a6a-7ffb-4859-938b-6d745de3600b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:57.430295 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-65460a6a-7ffb-4859-938b-6d745de3600b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:57.438102 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-65460a6a-7ffb-4859-938b-6d745de3600b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:57.438598 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-65460a6a-7ffb-4859-938b-6d745de3600b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:57.439031 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-65460a6a-7ffb-4859-938b-6d745de3600b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:57.439750 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-65460a6a-7ffb-4859-938b-6d745de3600b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:57.440200 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-65460a6a-7ffb-4859-938b-6d745de3600b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:57.440657 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-65460a6a-7ffb-4859-938b-6d745de3600b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:57.603368 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-65460a6a-7ffb-4859-938b-6d745de3600b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:57.612091 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-65460a6a-7ffb-4859-938b-6d745de3600b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.186330 Aug 05 20:04:57.616629 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 134/257] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:57 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:57.685801 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-8ba70bef-4f6d-4b15-a87b-b598d28a53d9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:57.686409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-8ba70bef-4f6d-4b15-a87b-b598d28a53d9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:57.693092 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8ba70bef-4f6d-4b15-a87b-b598d28a53d9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:57.693585 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8ba70bef-4f6d-4b15-a87b-b598d28a53d9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:57.694021 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8ba70bef-4f6d-4b15-a87b-b598d28a53d9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:57.694727 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8ba70bef-4f6d-4b15-a87b-b598d28a53d9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:57.695177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8ba70bef-4f6d-4b15-a87b-b598d28a53d9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:57.695601 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8ba70bef-4f6d-4b15-a87b-b598d28a53d9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:57.898741 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8ba70bef-4f6d-4b15-a87b-b598d28a53d9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:57.907746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8ba70bef-4f6d-4b15-a87b-b598d28a53d9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:57.909371 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8ba70bef-4f6d-4b15-a87b-b598d28a53d9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:57.910485 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-8ba70bef-4f6d-4b15-a87b-b598d28a53d9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1286 microversion: 2.20 time: 0.228855 Aug 05 20:04:57.911050 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 124/258] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:04:57 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1286 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:04:58.633045 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-86f5dbb8-468b-4853-b99d-d7cdceb46c7a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:58.633682 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-86f5dbb8-468b-4853-b99d-d7cdceb46c7a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:58.640440 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-86f5dbb8-468b-4853-b99d-d7cdceb46c7a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:58.640964 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-86f5dbb8-468b-4853-b99d-d7cdceb46c7a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:58.641402 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-86f5dbb8-468b-4853-b99d-d7cdceb46c7a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:58.642142 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-86f5dbb8-468b-4853-b99d-d7cdceb46c7a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:58.642535 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-86f5dbb8-468b-4853-b99d-d7cdceb46c7a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:58.642960 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-86f5dbb8-468b-4853-b99d-d7cdceb46c7a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:58.771705 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-86f5dbb8-468b-4853-b99d-d7cdceb46c7a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:58.780004 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-86f5dbb8-468b-4853-b99d-d7cdceb46c7a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.150888 Aug 05 20:04:58.780666 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 135/259] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:58 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:04:58.932757 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f009652c-d477-4fc9-8230-d1f6475e92f8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:58.933374 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f009652c-d477-4fc9-8230-d1f6475e92f8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:58.940115 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f009652c-d477-4fc9-8230-d1f6475e92f8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:58.940643 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f009652c-d477-4fc9-8230-d1f6475e92f8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:58.941085 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f009652c-d477-4fc9-8230-d1f6475e92f8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:58.941784 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f009652c-d477-4fc9-8230-d1f6475e92f8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:58.942245 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f009652c-d477-4fc9-8230-d1f6475e92f8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:58.942671 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f009652c-d477-4fc9-8230-d1f6475e92f8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:59.008213 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f009652c-d477-4fc9-8230-d1f6475e92f8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:59.019274 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f009652c-d477-4fc9-8230-d1f6475e92f8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:59.020867 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f009652c-d477-4fc9-8230-d1f6475e92f8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:59.021990 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f009652c-d477-4fc9-8230-d1f6475e92f8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1286 microversion: 2.20 time: 0.093216 Aug 05 20:04:59.022551 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 125/260] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:04:58 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:04:59.801792 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-d33b8891-48b9-4859-81c2-1e116d72c52b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:04:59.802401 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-d33b8891-48b9-4859-81c2-1e116d72c52b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:04:59.808304 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d33b8891-48b9-4859-81c2-1e116d72c52b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:59.808829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d33b8891-48b9-4859-81c2-1e116d72c52b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:59.809452 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d33b8891-48b9-4859-81c2-1e116d72c52b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:59.810184 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d33b8891-48b9-4859-81c2-1e116d72c52b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:04:59.810641 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d33b8891-48b9-4859-81c2-1e116d72c52b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:04:59.811067 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d33b8891-48b9-4859-81c2-1e116d72c52b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:04:59.954575 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-d33b8891-48b9-4859-81c2-1e116d72c52b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:04:59.961975 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-d33b8891-48b9-4859-81c2-1e116d72c52b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.164056 Aug 05 20:04:59.962545 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 136/261] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:04:59 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:00.044275 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-2c1c2a03-4617-423d-b943-a01388543241 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:00.044899 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-2c1c2a03-4617-423d-b943-a01388543241 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:00.051421 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2c1c2a03-4617-423d-b943-a01388543241 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:00.051910 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2c1c2a03-4617-423d-b943-a01388543241 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:00.052346 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2c1c2a03-4617-423d-b943-a01388543241 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:00.053070 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2c1c2a03-4617-423d-b943-a01388543241 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:00.053535 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2c1c2a03-4617-423d-b943-a01388543241 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:00.053961 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2c1c2a03-4617-423d-b943-a01388543241 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:00.116742 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-2c1c2a03-4617-423d-b943-a01388543241 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:00.125500 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-2c1c2a03-4617-423d-b943-a01388543241 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:00.127045 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-2c1c2a03-4617-423d-b943-a01388543241 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:00.128145 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-2c1c2a03-4617-423d-b943-a01388543241 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1286 microversion: 2.20 time: 0.087780 Aug 05 20:05:00.128723 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 126/262] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:00 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:05:00.984519 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-05f87ea9-971c-41a3-8e98-ba565d5d4fcb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:00.985167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-05f87ea9-971c-41a3-8e98-ba565d5d4fcb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:00.991078 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-05f87ea9-971c-41a3-8e98-ba565d5d4fcb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:00.991563 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-05f87ea9-971c-41a3-8e98-ba565d5d4fcb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:00.991999 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-05f87ea9-971c-41a3-8e98-ba565d5d4fcb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:00.992713 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-05f87ea9-971c-41a3-8e98-ba565d5d4fcb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:00.993168 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-05f87ea9-971c-41a3-8e98-ba565d5d4fcb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:00.993592 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-05f87ea9-971c-41a3-8e98-ba565d5d4fcb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:01.131547 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-05f87ea9-971c-41a3-8e98-ba565d5d4fcb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:01.139172 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-05f87ea9-971c-41a3-8e98-ba565d5d4fcb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.159729 Aug 05 20:05:01.139750 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 137/263] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:00 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:01.150610 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-b5dcc57d-c756-4cfd-830a-046f208c7070 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:01.151246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-b5dcc57d-c756-4cfd-830a-046f208c7070 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:01.157391 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b5dcc57d-c756-4cfd-830a-046f208c7070 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:01.157872 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b5dcc57d-c756-4cfd-830a-046f208c7070 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:01.158299 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b5dcc57d-c756-4cfd-830a-046f208c7070 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:01.158979 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b5dcc57d-c756-4cfd-830a-046f208c7070 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:01.159426 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b5dcc57d-c756-4cfd-830a-046f208c7070 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:01.159846 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b5dcc57d-c756-4cfd-830a-046f208c7070 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:01.222193 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-b5dcc57d-c756-4cfd-830a-046f208c7070 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:01.230275 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-b5dcc57d-c756-4cfd-830a-046f208c7070 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:01.232817 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-b5dcc57d-c756-4cfd-830a-046f208c7070 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:01.233912 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-b5dcc57d-c756-4cfd-830a-046f208c7070 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1286 microversion: 2.20 time: 0.087098 Aug 05 20:05:01.234466 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 127/264] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:01 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:05:02.159925 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-e4430572-a94f-4a53-9854-5614e62c5901 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:02.160539 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-e4430572-a94f-4a53-9854-5614e62c5901 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:02.166477 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e4430572-a94f-4a53-9854-5614e62c5901 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:02.166963 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e4430572-a94f-4a53-9854-5614e62c5901 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:02.167396 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e4430572-a94f-4a53-9854-5614e62c5901 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:02.168083 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e4430572-a94f-4a53-9854-5614e62c5901 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:02.168743 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e4430572-a94f-4a53-9854-5614e62c5901 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:02.169318 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e4430572-a94f-4a53-9854-5614e62c5901 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:02.256786 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-093b0d5b-2598-42a5-88e5-ae9796bd207f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:02.257400 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-093b0d5b-2598-42a5-88e5-ae9796bd207f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:02.264109 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-093b0d5b-2598-42a5-88e5-ae9796bd207f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:02.264650 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-093b0d5b-2598-42a5-88e5-ae9796bd207f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:02.265099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-093b0d5b-2598-42a5-88e5-ae9796bd207f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:02.265782 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-093b0d5b-2598-42a5-88e5-ae9796bd207f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:02.266236 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-093b0d5b-2598-42a5-88e5-ae9796bd207f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:02.266661 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-093b0d5b-2598-42a5-88e5-ae9796bd207f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:02.302859 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-e4430572-a94f-4a53-9854-5614e62c5901 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:02.310893 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-e4430572-a94f-4a53-9854-5614e62c5901 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.154743 Aug 05 20:05:02.311475 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 138/265] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:02 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:02.335659 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-093b0d5b-2598-42a5-88e5-ae9796bd207f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:02.344284 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-093b0d5b-2598-42a5-88e5-ae9796bd207f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:02.345822 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-093b0d5b-2598-42a5-88e5-ae9796bd207f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:02.346915 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-093b0d5b-2598-42a5-88e5-ae9796bd207f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1286 microversion: 2.20 time: 0.094006 Aug 05 20:05:02.347463 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 128/266] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:02 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:05:03.331218 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-53419a8e-85ff-4cc6-93f2-096a378e4ed9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:03.331833 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-53419a8e-85ff-4cc6-93f2-096a378e4ed9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:03.337825 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53419a8e-85ff-4cc6-93f2-096a378e4ed9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:03.338306 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53419a8e-85ff-4cc6-93f2-096a378e4ed9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:03.338912 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53419a8e-85ff-4cc6-93f2-096a378e4ed9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:03.339598 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53419a8e-85ff-4cc6-93f2-096a378e4ed9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:03.340098 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53419a8e-85ff-4cc6-93f2-096a378e4ed9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:03.340521 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53419a8e-85ff-4cc6-93f2-096a378e4ed9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:03.370144 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-31d05b85-6e06-4043-8274-3b83332a5751 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:03.370758 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-31d05b85-6e06-4043-8274-3b83332a5751 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:03.377881 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-31d05b85-6e06-4043-8274-3b83332a5751 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:03.378369 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-31d05b85-6e06-4043-8274-3b83332a5751 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:03.378805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-31d05b85-6e06-4043-8274-3b83332a5751 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:03.379499 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-31d05b85-6e06-4043-8274-3b83332a5751 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:03.379950 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-31d05b85-6e06-4043-8274-3b83332a5751 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:03.380372 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-31d05b85-6e06-4043-8274-3b83332a5751 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:03.460484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-31d05b85-6e06-4043-8274-3b83332a5751 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:03.469512 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-31d05b85-6e06-4043-8274-3b83332a5751 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:03.471028 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-31d05b85-6e06-4043-8274-3b83332a5751 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:03.472162 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-31d05b85-6e06-4043-8274-3b83332a5751 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1334 microversion: 2.20 time: 0.106012 Aug 05 20:05:03.472747 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 129/267] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:03 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1334 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:05:03.491326 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-53419a8e-85ff-4cc6-93f2-096a378e4ed9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:03.499330 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-53419a8e-85ff-4cc6-93f2-096a378e4ed9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.171852 Aug 05 20:05:03.499985 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 139/268] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:03 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:05:04.495310 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-de16ffe1-811e-4f20-bac8-108ff5ea73d3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:04.495912 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-de16ffe1-811e-4f20-bac8-108ff5ea73d3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:04.504902 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-de16ffe1-811e-4f20-bac8-108ff5ea73d3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:04.505435 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-de16ffe1-811e-4f20-bac8-108ff5ea73d3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:04.505877 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-de16ffe1-811e-4f20-bac8-108ff5ea73d3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:04.506565 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-de16ffe1-811e-4f20-bac8-108ff5ea73d3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:04.507064 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-de16ffe1-811e-4f20-bac8-108ff5ea73d3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:04.507508 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-de16ffe1-811e-4f20-bac8-108ff5ea73d3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:04.521572 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-86702c33-b794-41d0-84b8-c6bde9c57368 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:04.523108 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-86702c33-b794-41d0-84b8-c6bde9c57368 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:04.531328 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-86702c33-b794-41d0-84b8-c6bde9c57368 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:04.531830 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-86702c33-b794-41d0-84b8-c6bde9c57368 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:04.532266 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-86702c33-b794-41d0-84b8-c6bde9c57368 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:04.539850 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:04.542168 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-86702c33-b794-41d0-84b8-c6bde9c57368 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:04.542804 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-86702c33-b794-41d0-84b8-c6bde9c57368 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:04.543372 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-86702c33-b794-41d0-84b8-c6bde9c57368 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:04.745464 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-de16ffe1-811e-4f20-bac8-108ff5ea73d3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:04.754430 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-de16ffe1-811e-4f20-bac8-108ff5ea73d3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:04.755951 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-de16ffe1-811e-4f20-bac8-108ff5ea73d3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:04.757253 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-de16ffe1-811e-4f20-bac8-108ff5ea73d3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.265863 Aug 05 20:05:04.757817 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 130/269] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:04 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:05:04.761896 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-86702c33-b794-41d0-84b8-c6bde9c57368 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:04.770119 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-86702c33-b794-41d0-84b8-c6bde9c57368 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.253325 Aug 05 20:05:04.770634 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 140/270] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:04 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:05.782310 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-967c9a1c-2358-45e7-875e-d31af022efa0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:05.782925 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-967c9a1c-2358-45e7-875e-d31af022efa0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:05.789486 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-967c9a1c-2358-45e7-875e-d31af022efa0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:05.789971 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-967c9a1c-2358-45e7-875e-d31af022efa0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:05.790436 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-967c9a1c-2358-45e7-875e-d31af022efa0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:05.791008 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-2e341065-34b7-4e2c-9ecc-beef6b4eb1e5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:05.791424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-967c9a1c-2358-45e7-875e-d31af022efa0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:05.791560 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-967c9a1c-2358-45e7-875e-d31af022efa0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:05.791654 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-2e341065-34b7-4e2c-9ecc-beef6b4eb1e5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:05.791978 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-967c9a1c-2358-45e7-875e-d31af022efa0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:05.798216 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2e341065-34b7-4e2c-9ecc-beef6b4eb1e5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:05.798698 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2e341065-34b7-4e2c-9ecc-beef6b4eb1e5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:05.799134 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2e341065-34b7-4e2c-9ecc-beef6b4eb1e5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:05.799839 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2e341065-34b7-4e2c-9ecc-beef6b4eb1e5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:05.800285 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2e341065-34b7-4e2c-9ecc-beef6b4eb1e5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:05.800738 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2e341065-34b7-4e2c-9ecc-beef6b4eb1e5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:05.978377 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-967c9a1c-2358-45e7-875e-d31af022efa0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:05.987975 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-967c9a1c-2358-45e7-875e-d31af022efa0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:05.989650 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-967c9a1c-2358-45e7-875e-d31af022efa0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:05.990730 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-2e341065-34b7-4e2c-9ecc-beef6b4eb1e5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:05.990838 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-967c9a1c-2358-45e7-875e-d31af022efa0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.213738 Aug 05 20:05:05.991470 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 131/271] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:05 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:05:06.000601 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-2e341065-34b7-4e2c-9ecc-beef6b4eb1e5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.213236 Aug 05 20:05:06.001319 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 141/272] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:05 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:05:07.014439 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-45fe103e-1655-468f-a522-0faa3b6b1f52 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:07.015052 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-45fe103e-1655-468f-a522-0faa3b6b1f52 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:07.022256 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=2 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:07.023095 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-11951679-b395-4640-9e5c-1dae5aaefe88 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:07.023910 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-11951679-b395-4640-9e5c-1dae5aaefe88 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:07.024560 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-45fe103e-1655-468f-a522-0faa3b6b1f52 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:07.025073 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-45fe103e-1655-468f-a522-0faa3b6b1f52 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:07.025521 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-45fe103e-1655-468f-a522-0faa3b6b1f52 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:07.026269 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-45fe103e-1655-468f-a522-0faa3b6b1f52 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:07.026551 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell0:SELECT=2 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:07.026764 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-45fe103e-1655-468f-a522-0faa3b6b1f52 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:07.027360 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-45fe103e-1655-468f-a522-0faa3b6b1f52 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:07.027680 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell0:SELECT=10 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:07.035878 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-11951679-b395-4640-9e5c-1dae5aaefe88 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:07.036612 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-11951679-b395-4640-9e5c-1dae5aaefe88 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:07.037077 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-11951679-b395-4640-9e5c-1dae5aaefe88 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:07.038104 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-11951679-b395-4640-9e5c-1dae5aaefe88 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:07.038639 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-11951679-b395-4640-9e5c-1dae5aaefe88 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:07.039164 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-11951679-b395-4640-9e5c-1dae5aaefe88 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:07.240453 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-45fe103e-1655-468f-a522-0faa3b6b1f52 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:07.242664 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-11951679-b395-4640-9e5c-1dae5aaefe88 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:07.248244 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-45fe103e-1655-468f-a522-0faa3b6b1f52 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:07.249889 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-45fe103e-1655-468f-a522-0faa3b6b1f52 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:07.251265 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-45fe103e-1655-468f-a522-0faa3b6b1f52 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.240769 Aug 05 20:05:07.251760 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 132/273] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:07 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:05:07.252536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-11951679-b395-4640-9e5c-1dae5aaefe88 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.233440 Aug 05 20:05:07.254168 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 142/274] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:07 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:05:08.274369 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e9b4fe15-d9c5-4247-b3c3-e8ef2a26f876 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:08.275069 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4aa030e8-7d07-4e03-90ed-5a5947badf95 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:08.275487 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e9b4fe15-d9c5-4247-b3c3-e8ef2a26f876 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:08.276325 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-4aa030e8-7d07-4e03-90ed-5a5947badf95 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:08.283136 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4aa030e8-7d07-4e03-90ed-5a5947badf95 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:08.283696 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e9b4fe15-d9c5-4247-b3c3-e8ef2a26f876 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:08.284015 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4aa030e8-7d07-4e03-90ed-5a5947badf95 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:08.284387 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e9b4fe15-d9c5-4247-b3c3-e8ef2a26f876 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:08.284811 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4aa030e8-7d07-4e03-90ed-5a5947badf95 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:08.285057 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e9b4fe15-d9c5-4247-b3c3-e8ef2a26f876 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:08.285877 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4aa030e8-7d07-4e03-90ed-5a5947badf95 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:08.286106 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e9b4fe15-d9c5-4247-b3c3-e8ef2a26f876 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:08.286662 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e9b4fe15-d9c5-4247-b3c3-e8ef2a26f876 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:08.286926 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4aa030e8-7d07-4e03-90ed-5a5947badf95 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:08.287280 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e9b4fe15-d9c5-4247-b3c3-e8ef2a26f876 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:08.287663 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4aa030e8-7d07-4e03-90ed-5a5947badf95 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:08.588177 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-4aa030e8-7d07-4e03-90ed-5a5947badf95 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:08.596949 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-4aa030e8-7d07-4e03-90ed-5a5947badf95 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.325664 Aug 05 20:05:08.597615 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 143/275] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:08 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:05:08.602518 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e9b4fe15-d9c5-4247-b3c3-e8ef2a26f876 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:08.610682 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e9b4fe15-d9c5-4247-b3c3-e8ef2a26f876 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:08.612190 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e9b4fe15-d9c5-4247-b3c3-e8ef2a26f876 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:08.613344 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e9b4fe15-d9c5-4247-b3c3-e8ef2a26f876 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.342997 Aug 05 20:05:08.614070 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 133/276] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:08 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:05:08.722237 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-ec4c6755-156c-4563-86a2-c9946ab06dfb req-e5932118-f723-437d-88c2-69558f147a64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98e6fc07-61b1-455d-8bf0-563c5debbebb", "tag": "e1afce7c-4bdd-432b-905f-443b0227fa80"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:05:08.731993 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-ec4c6755-156c-4563-86a2-c9946ab06dfb req-e5932118-f723-437d-88c2-69558f147a64 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:08.732473 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-ec4c6755-156c-4563-86a2-c9946ab06dfb req-e5932118-f723-437d-88c2-69558f147a64 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:08.732941 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-ec4c6755-156c-4563-86a2-c9946ab06dfb req-e5932118-f723-437d-88c2-69558f147a64 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:08.743747 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-ec4c6755-156c-4563-86a2-c9946ab06dfb req-e5932118-f723-437d-88c2-69558f147a64 service nova] Creating event network-changed:e1afce7c-4bdd-432b-905f-443b0227fa80 for instance 98e6fc07-61b1-455d-8bf0-563c5debbebb on hv-cinder-85221 Aug 05 20:05:08.749716 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-ec4c6755-156c-4563-86a2-c9946ab06dfb req-e5932118-f723-437d-88c2-69558f147a64 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031245 Aug 05 20:05:08.750476 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 144/277] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:05:09.618491 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-4bfb17ef-18fe-46d7-8210-92d9f654925e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:09.619112 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-4bfb17ef-18fe-46d7-8210-92d9f654925e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:09.626555 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4bfb17ef-18fe-46d7-8210-92d9f654925e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:09.627122 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4bfb17ef-18fe-46d7-8210-92d9f654925e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:09.627635 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4bfb17ef-18fe-46d7-8210-92d9f654925e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:09.628410 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4bfb17ef-18fe-46d7-8210-92d9f654925e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:09.628975 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4bfb17ef-18fe-46d7-8210-92d9f654925e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:09.629351 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4bfb17ef-18fe-46d7-8210-92d9f654925e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:09.636610 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-25877eaf-1639-42f9-a56c-a05279ad1273 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:09.638259 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-25877eaf-1639-42f9-a56c-a05279ad1273 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:09.645046 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-25877eaf-1639-42f9-a56c-a05279ad1273 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:09.645587 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-25877eaf-1639-42f9-a56c-a05279ad1273 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:09.645980 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-25877eaf-1639-42f9-a56c-a05279ad1273 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:09.646749 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-25877eaf-1639-42f9-a56c-a05279ad1273 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:09.647198 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-25877eaf-1639-42f9-a56c-a05279ad1273 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:09.647624 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-25877eaf-1639-42f9-a56c-a05279ad1273 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:10.022971 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-4bfb17ef-18fe-46d7-8210-92d9f654925e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:10.031394 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-4bfb17ef-18fe-46d7-8210-92d9f654925e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.416680 Aug 05 20:05:10.031971 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 134/278] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:09 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:10.047793 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-25877eaf-1639-42f9-a56c-a05279ad1273 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:10.055485 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-25877eaf-1639-42f9-a56c-a05279ad1273 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:10.057031 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-25877eaf-1639-42f9-a56c-a05279ad1273 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:10.058120 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-25877eaf-1639-42f9-a56c-a05279ad1273 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.426551 Aug 05 20:05:10.058847 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 145/279] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:09 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:05:11.052063 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-03e935fd-cc76-4b44-8af7-d2a0593be844 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:11.052612 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-03e935fd-cc76-4b44-8af7-d2a0593be844 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:11.061259 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-03e935fd-cc76-4b44-8af7-d2a0593be844 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:11.061734 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-03e935fd-cc76-4b44-8af7-d2a0593be844 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:11.062164 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-03e935fd-cc76-4b44-8af7-d2a0593be844 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:11.062846 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-03e935fd-cc76-4b44-8af7-d2a0593be844 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:11.063296 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-03e935fd-cc76-4b44-8af7-d2a0593be844 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:11.063716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-03e935fd-cc76-4b44-8af7-d2a0593be844 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:11.081430 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-90efb0fb-b6c7-4ce4-9d6c-86acec388151 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:11.082039 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-90efb0fb-b6c7-4ce4-9d6c-86acec388151 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:11.087819 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-90efb0fb-b6c7-4ce4-9d6c-86acec388151 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:11.088307 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-90efb0fb-b6c7-4ce4-9d6c-86acec388151 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:11.088779 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-90efb0fb-b6c7-4ce4-9d6c-86acec388151 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:11.089470 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-90efb0fb-b6c7-4ce4-9d6c-86acec388151 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:11.090721 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-90efb0fb-b6c7-4ce4-9d6c-86acec388151 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:11.091295 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-90efb0fb-b6c7-4ce4-9d6c-86acec388151 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:11.264716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-03e935fd-cc76-4b44-8af7-d2a0593be844 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:11.272492 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-03e935fd-cc76-4b44-8af7-d2a0593be844 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.224287 Aug 05 20:05:11.273104 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 135/280] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:11 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:05:11.283942 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-90efb0fb-b6c7-4ce4-9d6c-86acec388151 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:11.292190 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-90efb0fb-b6c7-4ce4-9d6c-86acec388151 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:11.294450 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-90efb0fb-b6c7-4ce4-9d6c-86acec388151 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:11.295554 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-90efb0fb-b6c7-4ce4-9d6c-86acec388151 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.217993 Aug 05 20:05:11.296093 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 146/281] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:11 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:05:12.295275 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-bc708e0c-57a9-43dd-86c9-e7b3427706ad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:12.295958 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-bc708e0c-57a9-43dd-86c9-e7b3427706ad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:12.302732 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bc708e0c-57a9-43dd-86c9-e7b3427706ad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:12.302732 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bc708e0c-57a9-43dd-86c9-e7b3427706ad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:12.303048 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bc708e0c-57a9-43dd-86c9-e7b3427706ad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:12.303739 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bc708e0c-57a9-43dd-86c9-e7b3427706ad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:12.304192 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bc708e0c-57a9-43dd-86c9-e7b3427706ad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:12.304637 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bc708e0c-57a9-43dd-86c9-e7b3427706ad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:12.318838 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-0f4bf344-8655-4d05-9084-5fc79b27551a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:12.320184 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-0f4bf344-8655-4d05-9084-5fc79b27551a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:12.326822 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0f4bf344-8655-4d05-9084-5fc79b27551a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:12.327358 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0f4bf344-8655-4d05-9084-5fc79b27551a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:12.327801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0f4bf344-8655-4d05-9084-5fc79b27551a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:12.328507 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0f4bf344-8655-4d05-9084-5fc79b27551a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:12.328990 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0f4bf344-8655-4d05-9084-5fc79b27551a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:12.329416 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0f4bf344-8655-4d05-9084-5fc79b27551a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:12.544850 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-bc708e0c-57a9-43dd-86c9-e7b3427706ad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:12.550606 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-0f4bf344-8655-4d05-9084-5fc79b27551a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:12.552398 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-bc708e0c-57a9-43dd-86c9-e7b3427706ad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.261749 Aug 05 20:05:12.553005 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 136/282] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:12 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:12.559717 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-0f4bf344-8655-4d05-9084-5fc79b27551a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:12.561350 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-0f4bf344-8655-4d05-9084-5fc79b27551a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:12.562529 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-0f4bf344-8655-4d05-9084-5fc79b27551a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.248577 Aug 05 20:05:12.563143 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 147/283] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:12 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:05:13.575622 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-2b96a6f0-b64f-403f-bb02-2cf6f1acf420 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:13.576888 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-2b96a6f0-b64f-403f-bb02-2cf6f1acf420 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:13.583844 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2b96a6f0-b64f-403f-bb02-2cf6f1acf420 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:13.584334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2b96a6f0-b64f-403f-bb02-2cf6f1acf420 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:13.584808 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2b96a6f0-b64f-403f-bb02-2cf6f1acf420 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:13.585506 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2b96a6f0-b64f-403f-bb02-2cf6f1acf420 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:13.585706 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-702c5536-9a1c-4704-924c-5469523e605e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:13.586137 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2b96a6f0-b64f-403f-bb02-2cf6f1acf420 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:13.586325 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-702c5536-9a1c-4704-924c-5469523e605e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:13.586420 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2b96a6f0-b64f-403f-bb02-2cf6f1acf420 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:13.593019 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-702c5536-9a1c-4704-924c-5469523e605e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:13.593514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-702c5536-9a1c-4704-924c-5469523e605e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:13.593964 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-702c5536-9a1c-4704-924c-5469523e605e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:13.594684 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-702c5536-9a1c-4704-924c-5469523e605e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:13.595116 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-702c5536-9a1c-4704-924c-5469523e605e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:13.595542 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-702c5536-9a1c-4704-924c-5469523e605e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:13.811802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-702c5536-9a1c-4704-924c-5469523e605e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:13.818287 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-2b96a6f0-b64f-403f-bb02-2cf6f1acf420 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:13.821448 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-702c5536-9a1c-4704-924c-5469523e605e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:13.823303 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-702c5536-9a1c-4704-924c-5469523e605e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:13.825029 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-702c5536-9a1c-4704-924c-5469523e605e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.243456 Aug 05 20:05:13.825781 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 148/284] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:13 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:05:13.827119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-2b96a6f0-b64f-403f-bb02-2cf6f1acf420 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.257072 Aug 05 20:05:13.827683 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 137/285] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:13 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:14.849040 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-08b5b140-1bd4-4d00-b583-499713f09c7e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:14.849677 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-08b5b140-1bd4-4d00-b583-499713f09c7e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:14.850084 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-30fbb490-04bb-49d5-8990-f2b01584494b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:14.850698 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-30fbb490-04bb-49d5-8990-f2b01584494b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:14.856046 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-08b5b140-1bd4-4d00-b583-499713f09c7e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:14.856724 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-08b5b140-1bd4-4d00-b583-499713f09c7e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:14.857167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-08b5b140-1bd4-4d00-b583-499713f09c7e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:14.857268 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-30fbb490-04bb-49d5-8990-f2b01584494b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:14.857666 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-30fbb490-04bb-49d5-8990-f2b01584494b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:14.857867 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-08b5b140-1bd4-4d00-b583-499713f09c7e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:14.858101 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-30fbb490-04bb-49d5-8990-f2b01584494b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:14.858363 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-08b5b140-1bd4-4d00-b583-499713f09c7e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:14.858758 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-08b5b140-1bd4-4d00-b583-499713f09c7e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:14.858868 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-30fbb490-04bb-49d5-8990-f2b01584494b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:14.859234 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-30fbb490-04bb-49d5-8990-f2b01584494b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:14.859659 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-30fbb490-04bb-49d5-8990-f2b01584494b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:15.057568 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-08b5b140-1bd4-4d00-b583-499713f09c7e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:15.062332 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-30fbb490-04bb-49d5-8990-f2b01584494b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:15.065815 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-08b5b140-1bd4-4d00-b583-499713f09c7e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.220525 Aug 05 20:05:15.066385 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 149/286] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:14 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:15.070203 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-30fbb490-04bb-49d5-8990-f2b01584494b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:15.071707 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-30fbb490-04bb-49d5-8990-f2b01584494b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:15.072837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-30fbb490-04bb-49d5-8990-f2b01584494b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.226748 Aug 05 20:05:15.073386 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 138/287] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:14 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:05:16.085668 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-805f07c4-ea0f-43d9-a349-bf5c2deb118a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:16.086273 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-805f07c4-ea0f-43d9-a349-bf5c2deb118a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:16.093104 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-805f07c4-ea0f-43d9-a349-bf5c2deb118a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:16.093572 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-805f07c4-ea0f-43d9-a349-bf5c2deb118a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:16.094055 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-805f07c4-ea0f-43d9-a349-bf5c2deb118a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:16.094690 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-805f07c4-ea0f-43d9-a349-bf5c2deb118a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:16.095139 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-805f07c4-ea0f-43d9-a349-bf5c2deb118a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:16.095253 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9ef0c9d4-fd53-4fa7-9428-978207622cc7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:16.095647 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-805f07c4-ea0f-43d9-a349-bf5c2deb118a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:16.095740 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-9ef0c9d4-fd53-4fa7-9428-978207622cc7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:16.106405 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9ef0c9d4-fd53-4fa7-9428-978207622cc7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:16.107289 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9ef0c9d4-fd53-4fa7-9428-978207622cc7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:16.108071 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9ef0c9d4-fd53-4fa7-9428-978207622cc7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:16.109393 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9ef0c9d4-fd53-4fa7-9428-978207622cc7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:16.109891 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9ef0c9d4-fd53-4fa7-9428-978207622cc7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:16.110605 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9ef0c9d4-fd53-4fa7-9428-978207622cc7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:16.305828 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-805f07c4-ea0f-43d9-a349-bf5c2deb118a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:16.310575 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9ef0c9d4-fd53-4fa7-9428-978207622cc7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:16.314123 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-805f07c4-ea0f-43d9-a349-bf5c2deb118a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.232174 Aug 05 20:05:16.314693 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 150/288] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:16 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:16.318503 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9ef0c9d4-fd53-4fa7-9428-978207622cc7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:16.319995 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9ef0c9d4-fd53-4fa7-9428-978207622cc7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:16.321425 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-9ef0c9d4-fd53-4fa7-9428-978207622cc7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.230271 Aug 05 20:05:16.321972 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 139/289] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:16 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:05:17.335111 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-51ecf6d4-6743-412f-a3ff-ab735cbac62e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:17.335835 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-51ecf6d4-6743-412f-a3ff-ab735cbac62e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:17.337959 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:17.344628 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-51ecf6d4-6743-412f-a3ff-ab735cbac62e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:17.344788 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a6642eac-a0d1-48e0-b34a-d3ea425adfbd tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:17.345205 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-51ecf6d4-6743-412f-a3ff-ab735cbac62e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:17.345310 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-a6642eac-a0d1-48e0-b34a-d3ea425adfbd tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:17.345560 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-51ecf6d4-6743-412f-a3ff-ab735cbac62e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:17.346269 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-51ecf6d4-6743-412f-a3ff-ab735cbac62e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:17.346729 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-51ecf6d4-6743-412f-a3ff-ab735cbac62e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:17.347159 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-51ecf6d4-6743-412f-a3ff-ab735cbac62e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:17.348801 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=48 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:17.351988 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=100 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:17.352783 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a6642eac-a0d1-48e0-b34a-d3ea425adfbd tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:17.353265 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a6642eac-a0d1-48e0-b34a-d3ea425adfbd tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:17.353699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a6642eac-a0d1-48e0-b34a-d3ea425adfbd tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:17.354381 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a6642eac-a0d1-48e0-b34a-d3ea425adfbd tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:17.355024 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a6642eac-a0d1-48e0-b34a-d3ea425adfbd tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:17.355549 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a6642eac-a0d1-48e0-b34a-d3ea425adfbd tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:17.554299 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-51ecf6d4-6743-412f-a3ff-ab735cbac62e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:17.559737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a6642eac-a0d1-48e0-b34a-d3ea425adfbd tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:17.562399 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-51ecf6d4-6743-412f-a3ff-ab735cbac62e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.231087 Aug 05 20:05:17.562959 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 151/290] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:17 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:17.567641 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a6642eac-a0d1-48e0-b34a-d3ea425adfbd tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:17.569172 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a6642eac-a0d1-48e0-b34a-d3ea425adfbd tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:17.570266 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-a6642eac-a0d1-48e0-b34a-d3ea425adfbd tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.230749 Aug 05 20:05:17.575236 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 140/291] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:17 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:05:18.583039 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-1b136395-30ca-4358-92cd-45b3ae24eb80 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:18.583653 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-1b136395-30ca-4358-92cd-45b3ae24eb80 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:18.590316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1b136395-30ca-4358-92cd-45b3ae24eb80 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:18.590807 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1b136395-30ca-4358-92cd-45b3ae24eb80 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:18.591248 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1b136395-30ca-4358-92cd-45b3ae24eb80 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:18.591949 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1b136395-30ca-4358-92cd-45b3ae24eb80 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:18.592403 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1b136395-30ca-4358-92cd-45b3ae24eb80 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:18.592858 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1b136395-30ca-4358-92cd-45b3ae24eb80 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:18.594739 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-53f43470-a394-4017-a822-106677c6dd9d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:18.595353 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-53f43470-a394-4017-a822-106677c6dd9d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:18.601711 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-53f43470-a394-4017-a822-106677c6dd9d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:18.602179 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-53f43470-a394-4017-a822-106677c6dd9d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:18.602609 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-53f43470-a394-4017-a822-106677c6dd9d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:18.603291 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-53f43470-a394-4017-a822-106677c6dd9d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:18.603737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-53f43470-a394-4017-a822-106677c6dd9d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:18.604153 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-53f43470-a394-4017-a822-106677c6dd9d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:18.797569 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-1b136395-30ca-4358-92cd-45b3ae24eb80 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:18.803667 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-53f43470-a394-4017-a822-106677c6dd9d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:18.805243 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-1b136395-30ca-4358-92cd-45b3ae24eb80 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.225965 Aug 05 20:05:18.805809 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 152/292] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:18 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:05:18.812190 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-53f43470-a394-4017-a822-106677c6dd9d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:18.813712 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-53f43470-a394-4017-a822-106677c6dd9d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:18.814809 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-53f43470-a394-4017-a822-106677c6dd9d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.224220 Aug 05 20:05:18.815382 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 141/293] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:18 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:05:19.829813 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-2c197b3e-683e-42c1-877a-8c755a48e14c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:19.830418 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-2c197b3e-683e-42c1-877a-8c755a48e14c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:19.836328 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2c197b3e-683e-42c1-877a-8c755a48e14c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:19.836834 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2c197b3e-683e-42c1-877a-8c755a48e14c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:19.837095 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-93e75b4a-52cb-4237-b7d5-fca8159a25e1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:19.837493 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2c197b3e-683e-42c1-877a-8c755a48e14c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:19.837704 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-93e75b4a-52cb-4237-b7d5-fca8159a25e1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:19.837932 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2c197b3e-683e-42c1-877a-8c755a48e14c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:19.838378 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2c197b3e-683e-42c1-877a-8c755a48e14c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:19.838795 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2c197b3e-683e-42c1-877a-8c755a48e14c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:19.844494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-93e75b4a-52cb-4237-b7d5-fca8159a25e1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:19.845003 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-93e75b4a-52cb-4237-b7d5-fca8159a25e1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:19.845432 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-93e75b4a-52cb-4237-b7d5-fca8159a25e1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:19.846114 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-93e75b4a-52cb-4237-b7d5-fca8159a25e1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:19.846559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-93e75b4a-52cb-4237-b7d5-fca8159a25e1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:19.846974 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-93e75b4a-52cb-4237-b7d5-fca8159a25e1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:20.035399 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-2c197b3e-683e-42c1-877a-8c755a48e14c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:20.039223 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-93e75b4a-52cb-4237-b7d5-fca8159a25e1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:20.043437 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-2c197b3e-683e-42c1-877a-8c755a48e14c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.217353 Aug 05 20:05:20.044007 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 153/294] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:19 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:20.047637 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-93e75b4a-52cb-4237-b7d5-fca8159a25e1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:20.049194 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-93e75b4a-52cb-4237-b7d5-fca8159a25e1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:20.050297 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-93e75b4a-52cb-4237-b7d5-fca8159a25e1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.217006 Aug 05 20:05:20.050846 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 142/295] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:19 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:05:21.064717 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-94fda7ce-34f2-4a18-8b6a-1451afd89102 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:21.065238 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-94fda7ce-34f2-4a18-8b6a-1451afd89102 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:21.071197 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-94fda7ce-34f2-4a18-8b6a-1451afd89102 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:21.071681 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-94fda7ce-34f2-4a18-8b6a-1451afd89102 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:21.072111 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-94fda7ce-34f2-4a18-8b6a-1451afd89102 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:21.072433 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-4d9dd63f-12f4-4588-b986-25ddf2766167 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:21.072860 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-94fda7ce-34f2-4a18-8b6a-1451afd89102 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:21.073074 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-4d9dd63f-12f4-4588-b986-25ddf2766167 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:21.073805 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-94fda7ce-34f2-4a18-8b6a-1451afd89102 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:21.074314 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-94fda7ce-34f2-4a18-8b6a-1451afd89102 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:21.079964 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4d9dd63f-12f4-4588-b986-25ddf2766167 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:21.080445 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4d9dd63f-12f4-4588-b986-25ddf2766167 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:21.081148 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4d9dd63f-12f4-4588-b986-25ddf2766167 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:21.081843 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4d9dd63f-12f4-4588-b986-25ddf2766167 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:21.082302 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4d9dd63f-12f4-4588-b986-25ddf2766167 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:21.082730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4d9dd63f-12f4-4588-b986-25ddf2766167 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:21.265519 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-94fda7ce-34f2-4a18-8b6a-1451afd89102 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:21.274040 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-94fda7ce-34f2-4a18-8b6a-1451afd89102 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.213413 Aug 05 20:05:21.274595 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 154/296] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:21 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:21.278607 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-4d9dd63f-12f4-4588-b986-25ddf2766167 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:21.286831 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-4d9dd63f-12f4-4588-b986-25ddf2766167 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:21.288375 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-4d9dd63f-12f4-4588-b986-25ddf2766167 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:21.289516 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-4d9dd63f-12f4-4588-b986-25ddf2766167 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.220948 Aug 05 20:05:21.290068 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 143/297] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:21 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:05:22.294926 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-709f19f1-3320-4b64-8f33-7b7e0cc723b6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:22.295534 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-709f19f1-3320-4b64-8f33-7b7e0cc723b6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:22.301394 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-709f19f1-3320-4b64-8f33-7b7e0cc723b6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:22.301963 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-709f19f1-3320-4b64-8f33-7b7e0cc723b6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:22.302297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-709f19f1-3320-4b64-8f33-7b7e0cc723b6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:22.302980 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-709f19f1-3320-4b64-8f33-7b7e0cc723b6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:22.303443 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-709f19f1-3320-4b64-8f33-7b7e0cc723b6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:22.303858 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-709f19f1-3320-4b64-8f33-7b7e0cc723b6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:22.312871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f5ad7d8b-56fc-468a-b76e-c43fe079c5da tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:22.313476 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f5ad7d8b-56fc-468a-b76e-c43fe079c5da tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:22.320265 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f5ad7d8b-56fc-468a-b76e-c43fe079c5da tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:22.320818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f5ad7d8b-56fc-468a-b76e-c43fe079c5da tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:22.321262 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f5ad7d8b-56fc-468a-b76e-c43fe079c5da tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:22.321964 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f5ad7d8b-56fc-468a-b76e-c43fe079c5da tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:22.322418 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f5ad7d8b-56fc-468a-b76e-c43fe079c5da tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:22.322846 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f5ad7d8b-56fc-468a-b76e-c43fe079c5da tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:22.509524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-709f19f1-3320-4b64-8f33-7b7e0cc723b6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:22.518086 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-709f19f1-3320-4b64-8f33-7b7e0cc723b6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.226815 Aug 05 20:05:22.518654 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 155/298] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:22 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:22.521863 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f5ad7d8b-56fc-468a-b76e-c43fe079c5da tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:22.530527 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f5ad7d8b-56fc-468a-b76e-c43fe079c5da tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:22.532039 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f5ad7d8b-56fc-468a-b76e-c43fe079c5da tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:22.533197 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f5ad7d8b-56fc-468a-b76e-c43fe079c5da tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.224328 Aug 05 20:05:22.533758 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 144/299] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:22 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:05:23.539322 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-be1b858b-9560-402d-a4a0-628095304650 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:23.539954 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-be1b858b-9560-402d-a4a0-628095304650 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:23.545910 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-be1b858b-9560-402d-a4a0-628095304650 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:23.546391 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-be1b858b-9560-402d-a4a0-628095304650 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:23.546822 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-be1b858b-9560-402d-a4a0-628095304650 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:23.547502 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-be1b858b-9560-402d-a4a0-628095304650 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:23.547956 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-be1b858b-9560-402d-a4a0-628095304650 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:23.548932 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-be1b858b-9560-402d-a4a0-628095304650 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:23.555628 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e13e9369-b922-4386-933d-011d4d79b4e2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:23.557066 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e13e9369-b922-4386-933d-011d4d79b4e2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:23.565202 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e13e9369-b922-4386-933d-011d4d79b4e2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:23.566286 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e13e9369-b922-4386-933d-011d4d79b4e2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:23.566964 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e13e9369-b922-4386-933d-011d4d79b4e2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:23.567929 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e13e9369-b922-4386-933d-011d4d79b4e2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:23.568641 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e13e9369-b922-4386-933d-011d4d79b4e2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:23.569284 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e13e9369-b922-4386-933d-011d4d79b4e2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:23.756076 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-be1b858b-9560-402d-a4a0-628095304650 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:23.772716 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-be1b858b-9560-402d-a4a0-628095304650 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.237230 Aug 05 20:05:23.773302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 156/300] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:23 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:23.787366 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e13e9369-b922-4386-933d-011d4d79b4e2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:23.797185 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e13e9369-b922-4386-933d-011d4d79b4e2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:23.798823 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e13e9369-b922-4386-933d-011d4d79b4e2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:23.800192 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e13e9369-b922-4386-933d-011d4d79b4e2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.248601 Aug 05 20:05:23.800883 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 145/301] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:23 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:05:23.945474 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-fe39e078-27ba-40b2-89b0-925272a8b887 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b459dbd-3395-4b85-be78-22c67981c565", "device": "/dev/sdb"}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:05:23.948667 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-fe39e078-27ba-40b2-89b0-925272a8b887 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:23.955381 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fe39e078-27ba-40b2-89b0-925272a8b887 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:23.956121 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fe39e078-27ba-40b2-89b0-925272a8b887 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:23.956551 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fe39e078-27ba-40b2-89b0-925272a8b887 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:23.957265 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fe39e078-27ba-40b2-89b0-925272a8b887 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:23.957709 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fe39e078-27ba-40b2-89b0-925272a8b887 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:23.958134 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fe39e078-27ba-40b2-89b0-925272a8b887 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:24.798935 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-c57c3f35-bce3-460d-9c13-45d921f6dcf1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:24.799828 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-c57c3f35-bce3-460d-9c13-45d921f6dcf1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:24.810066 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c57c3f35-bce3-460d-9c13-45d921f6dcf1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:24.810746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c57c3f35-bce3-460d-9c13-45d921f6dcf1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:24.811244 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c57c3f35-bce3-460d-9c13-45d921f6dcf1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:24.812018 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c57c3f35-bce3-460d-9c13-45d921f6dcf1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:24.812473 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c57c3f35-bce3-460d-9c13-45d921f6dcf1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:24.812926 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c57c3f35-bce3-460d-9c13-45d921f6dcf1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:24.960715 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-c57c3f35-bce3-460d-9c13-45d921f6dcf1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:24.981124 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-c57c3f35-bce3-460d-9c13-45d921f6dcf1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.186887 Aug 05 20:05:24.981720 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 146/302] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:24 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:24.986364 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-528a6ff6-606b-4a73-960e-d251d67b0404 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:24.987156 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-528a6ff6-606b-4a73-960e-d251d67b0404 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:24.993131 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-528a6ff6-606b-4a73-960e-d251d67b0404 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:24.993850 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-528a6ff6-606b-4a73-960e-d251d67b0404 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:24.994462 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-528a6ff6-606b-4a73-960e-d251d67b0404 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:24.995365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-528a6ff6-606b-4a73-960e-d251d67b0404 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:24.995989 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-528a6ff6-606b-4a73-960e-d251d67b0404 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:24.996551 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-528a6ff6-606b-4a73-960e-d251d67b0404 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:25.000771 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=100 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:25.202276 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-528a6ff6-606b-4a73-960e-d251d67b0404 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:25.212145 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-528a6ff6-606b-4a73-960e-d251d67b0404 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:25.214450 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-528a6ff6-606b-4a73-960e-d251d67b0404 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:25.215879 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-528a6ff6-606b-4a73-960e-d251d67b0404 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.233198 Aug 05 20:05:25.216678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 147/303] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:24 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:05:25.285665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-fe39e078-27ba-40b2-89b0-925272a8b887 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "POST /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.344367 Aug 05 20:05:25.286384 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 157/304] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Aug 5 20:05:23 2022] POST /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b/os-volume_attachments => generated 194 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:05:26.003287 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-5e86d64e-d5e0-40d9-bd19-d4c1e77827fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:26.004038 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-5e86d64e-d5e0-40d9-bd19-d4c1e77827fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:26.011361 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5e86d64e-d5e0-40d9-bd19-d4c1e77827fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:26.012065 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5e86d64e-d5e0-40d9-bd19-d4c1e77827fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:26.012693 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5e86d64e-d5e0-40d9-bd19-d4c1e77827fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:26.013812 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5e86d64e-d5e0-40d9-bd19-d4c1e77827fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:26.014220 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5e86d64e-d5e0-40d9-bd19-d4c1e77827fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:26.014644 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5e86d64e-d5e0-40d9-bd19-d4c1e77827fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:26.167104 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-5e86d64e-d5e0-40d9-bd19-d4c1e77827fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:26.176908 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-5e86d64e-d5e0-40d9-bd19-d4c1e77827fe tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.177378 Aug 05 20:05:26.178062 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 148/305] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:25 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:26.243393 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b2d445ab-8cc5-475f-82dc-55773b473824 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:26.244149 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-b2d445ab-8cc5-475f-82dc-55773b473824 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:26.252804 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b2d445ab-8cc5-475f-82dc-55773b473824 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:26.260129 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b2d445ab-8cc5-475f-82dc-55773b473824 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:26.261304 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b2d445ab-8cc5-475f-82dc-55773b473824 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:26.262046 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b2d445ab-8cc5-475f-82dc-55773b473824 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:26.262508 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b2d445ab-8cc5-475f-82dc-55773b473824 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:26.262930 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b2d445ab-8cc5-475f-82dc-55773b473824 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:26.446268 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-b2d445ab-8cc5-475f-82dc-55773b473824 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:26.455928 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-b2d445ab-8cc5-475f-82dc-55773b473824 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:26.457540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-b2d445ab-8cc5-475f-82dc-55773b473824 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:26.458829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b2d445ab-8cc5-475f-82dc-55773b473824 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.222930 Aug 05 20:05:26.459387 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 158/306] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:26 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:05:27.203115 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-cec4bb03-d3e6-4783-975e-aacd01755f39 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:27.203723 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-cec4bb03-d3e6-4783-975e-aacd01755f39 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:27.213012 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cec4bb03-d3e6-4783-975e-aacd01755f39 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:27.213504 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cec4bb03-d3e6-4783-975e-aacd01755f39 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:27.213993 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cec4bb03-d3e6-4783-975e-aacd01755f39 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:27.214688 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cec4bb03-d3e6-4783-975e-aacd01755f39 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:27.216254 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cec4bb03-d3e6-4783-975e-aacd01755f39 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:27.216735 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cec4bb03-d3e6-4783-975e-aacd01755f39 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:27.362966 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-cec4bb03-d3e6-4783-975e-aacd01755f39 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:27.372489 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-cec4bb03-d3e6-4783-975e-aacd01755f39 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.172942 Aug 05 20:05:27.385092 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 149/307] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:27 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:27.492917 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-8efedacb-b3e3-46df-812e-2c958d02986d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:27.493535 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-8efedacb-b3e3-46df-812e-2c958d02986d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:27.501287 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8efedacb-b3e3-46df-812e-2c958d02986d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:27.501959 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8efedacb-b3e3-46df-812e-2c958d02986d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:27.502544 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8efedacb-b3e3-46df-812e-2c958d02986d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:27.503402 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8efedacb-b3e3-46df-812e-2c958d02986d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:27.504433 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8efedacb-b3e3-46df-812e-2c958d02986d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:27.505044 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8efedacb-b3e3-46df-812e-2c958d02986d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:27.714151 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-8efedacb-b3e3-46df-812e-2c958d02986d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:27.723188 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-8efedacb-b3e3-46df-812e-2c958d02986d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:27.724980 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-8efedacb-b3e3-46df-812e-2c958d02986d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:27.726078 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-8efedacb-b3e3-46df-812e-2c958d02986d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.237622 Aug 05 20:05:27.726620 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 159/308] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:27 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:05:28.396154 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9b158e6d-fbbf-4297-99ac-ead00a08c83c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:28.419322 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-9b158e6d-fbbf-4297-99ac-ead00a08c83c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:28.434399 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9b158e6d-fbbf-4297-99ac-ead00a08c83c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:28.435640 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9b158e6d-fbbf-4297-99ac-ead00a08c83c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:28.436083 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9b158e6d-fbbf-4297-99ac-ead00a08c83c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:28.436820 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9b158e6d-fbbf-4297-99ac-ead00a08c83c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:28.437276 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9b158e6d-fbbf-4297-99ac-ead00a08c83c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:28.437698 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9b158e6d-fbbf-4297-99ac-ead00a08c83c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:28.651837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9b158e6d-fbbf-4297-99ac-ead00a08c83c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:28.659888 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-9b158e6d-fbbf-4297-99ac-ead00a08c83c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1502 microversion: 2.1 time: 0.268170 Aug 05 20:05:28.660663 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 150/309] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:28 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1502 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:28.680607 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-52612237-bbd3-425a-bfba-58b3de2a0d73 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "454a1a8c-d59c-45ec-8005-b976d7d92f70"}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:05:28.683816 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-52612237-bbd3-425a-bfba-58b3de2a0d73 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:28.690215 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-52612237-bbd3-425a-bfba-58b3de2a0d73 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:28.690704 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-52612237-bbd3-425a-bfba-58b3de2a0d73 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:28.691198 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-52612237-bbd3-425a-bfba-58b3de2a0d73 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:28.691832 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-52612237-bbd3-425a-bfba-58b3de2a0d73 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:28.692285 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-52612237-bbd3-425a-bfba-58b3de2a0d73 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:28.692746 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-52612237-bbd3-425a-bfba-58b3de2a0d73 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:28.751863 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-fc9f61c0-fb23-49ab-a242-056e995f1cb0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:28.753222 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-fc9f61c0-fb23-49ab-a242-056e995f1cb0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:28.760262 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc9f61c0-fb23-49ab-a242-056e995f1cb0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:28.761336 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc9f61c0-fb23-49ab-a242-056e995f1cb0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:28.761827 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc9f61c0-fb23-49ab-a242-056e995f1cb0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:28.762750 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc9f61c0-fb23-49ab-a242-056e995f1cb0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:28.763365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc9f61c0-fb23-49ab-a242-056e995f1cb0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:28.763948 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc9f61c0-fb23-49ab-a242-056e995f1cb0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:28.863480 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-52612237-bbd3-425a-bfba-58b3de2a0d73 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] HTTP exception thrown: Cannot 'attach_volume' instance eaafcd0b-5f14-4973-8cc5-274510846bc2 while it is in vm_state rescued Aug 05 20:05:28.865126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-52612237-bbd3-425a-bfba-58b3de2a0d73 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Request method failure captured: Aug 05 20:05:28.865126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: POST /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2/os-volume_attachments HTTP/1.1 Aug 05 20:05:28.865126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:05:28.865126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:05:28.865126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:05:28.865126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 74 Aug 05 20:05:28.865126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:05:28.865126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:05:28.865126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:05:28.865126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:05:28.865126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XdnvYt02KSUfuGZ4aMCLRd8A9W_4ugESxync32oagoq2m1bRquV2YcYbZy923ze2HKyg5orLp5ZPgQwQNpL1ZwXjKJN6rbHklb_4GvGBhZZEq-4iAyROqoLvdfOlApZwfRc8nLpUC3uM58ekKbcVuoIhI3WM4aUZiobfffRTVMm8jY Aug 05 20:05:28.865126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:05:28.865126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:05:28.865126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:05:28.865126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:05:28.865126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:05:28.865126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:05:28.865126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: c5b5718607784ec9be3289f7916f70a6 Aug 05 20:05:28.865126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1357645261 Aug 05 20:05:28.865126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:05:28.865126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:05:28.866895 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c5b5718607784ec9be3289f7916f70a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c5b5718607784ec9be3289f7916f70a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c5b5718607784ec9be3289f7916f70a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c5b5718607784ec9be3289f7916f70a6", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:05:28.866895 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1357645261 Aug 05 20:05:28.866895 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: c5b5718607784ec9be3289f7916f70a6 Aug 05 20:05:28.866895 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1357645261 Aug 05 20:05:28.866895 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-ServerRescueNegativeTestJSON-1357645261-project Aug 05 20:05:28.866895 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:05:28.866895 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:05:28.866895 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: 293b8a62f19c45c1bf5b897c7cf40edb Aug 05 20:05:28.866895 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1357645261-project Aug 05 20:05:28.866895 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Aug 05 20:05:28.866895 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {"volumeAttachment": {"volumeId": "454a1a8c-d59c-45ec-8005-b976d7d92f70"}} Aug 05 20:05:28.866895 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: > Aug 05 20:05:28.867837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Cannot 'attach_volume' instance eaafcd0b-5f14-4973-8cc5-274510846bc2 while it is in vm_state rescued Aug 05 20:05:28.867837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'server_id': 'eaafcd0b-5f14-4973-8cc5-274510846bc2', 'body': {'volumeAttachment': {'volumeId': '454a1a8c-d59c-45ec-8005-b976d7d92f70'}}} Aug 05 20:05:28.867837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:05:28.867837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:05:28.867837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 20:05:28.867837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 20:05:28.867837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 20:05:28.867837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 20:05:28.867837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 05 20:05:28.867837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 05 20:05:28.867837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance eaafcd0b-5f14-4973-8cc5-274510846bc2 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 05 20:05:28.867837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:05:28.867837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:05:28.867837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:05:28.867837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:05:28.867837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:05:28.867837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:05:28.867837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:05:28.867837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:05:28.870514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:05:28.870514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:05:28.870514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:05:28.870514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:05:28.870514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:05:28.870514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:05:28.870514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:05:28.870514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:05:28.870514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 05 20:05:28.870514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 05 20:05:28.870514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 05 20:05:28.870514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 05 20:05:28.870514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance eaafcd0b-5f14-4973-8cc5-274510846bc2 while it is in vm_state rescued Aug 05 20:05:28.870514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:05:28.870514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:05:28.870514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:05:28.870514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:05:28.870514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:05:28.870514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:05:28.872682 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:05:28.872682 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:05:28.872682 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance eaafcd0b-5f14-4973-8cc5-274510846bc2 while it is in vm_state rescued Aug 05 20:05:28.872682 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:05:28.872682 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-52612237-bbd3-425a-bfba-58b3de2a0d73 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Returning 409 to user: Cannot 'attach_volume' instance eaafcd0b-5f14-4973-8cc5-274510846bc2 while it is in vm_state rescued {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:05:28.872682 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-52612237-bbd3-425a-bfba-58b3de2a0d73 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "POST /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.190075 Aug 05 20:05:28.872682 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 160/310] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Aug 5 20:05:28 2022] POST /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2/os-volume_attachments => generated 152 bytes in 191 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 05 20:05:28.879317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-53fe3038-82d9-4244-a60c-77705eb86160 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:05:28.879945 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-53fe3038-82d9-4244-a60c-77705eb86160 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:28.886813 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53fe3038-82d9-4244-a60c-77705eb86160 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:28.887370 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53fe3038-82d9-4244-a60c-77705eb86160 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:28.888013 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53fe3038-82d9-4244-a60c-77705eb86160 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:28.888732 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53fe3038-82d9-4244-a60c-77705eb86160 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:28.889182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53fe3038-82d9-4244-a60c-77705eb86160 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:28.889599 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53fe3038-82d9-4244-a60c-77705eb86160 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:28.911071 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-fc9f61c0-fb23-49ab-a242-056e995f1cb0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:28.921163 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-fc9f61c0-fb23-49ab-a242-056e995f1cb0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:28.922814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-fc9f61c0-fb23-49ab-a242-056e995f1cb0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:28.924028 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-fc9f61c0-fb23-49ab-a242-056e995f1cb0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.176721 Aug 05 20:05:28.936604 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 151/311] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:28 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:05:28.973372 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-53fe3038-82d9-4244-a60c-77705eb86160 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "POST /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2/action" status: 202 len: 0 microversion: 2.1 time: 0.097429 Aug 05 20:05:28.974400 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 161/312] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Aug 5 20:05:28 2022] POST /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 20:05:28.985433 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-eaddaeb5-8fea-414b-81fb-d827188725d6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:28.986571 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-eaddaeb5-8fea-414b-81fb-d827188725d6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:28.994250 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eaddaeb5-8fea-414b-81fb-d827188725d6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:28.995740 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eaddaeb5-8fea-414b-81fb-d827188725d6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:28.996628 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eaddaeb5-8fea-414b-81fb-d827188725d6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:28.997642 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eaddaeb5-8fea-414b-81fb-d827188725d6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:28.998889 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eaddaeb5-8fea-414b-81fb-d827188725d6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:28.999575 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eaddaeb5-8fea-414b-81fb-d827188725d6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:29.254000 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-53314410-1636-4d98-b00f-49285decd7d5 req-5d6b2d05-81f7-44dc-8279-cc842e139495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98e6fc07-61b1-455d-8bf0-563c5debbebb", "name": "network-vif-plugged", "status": "completed", "tag": "e1afce7c-4bdd-432b-905f-443b0227fa80"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:05:29.276120 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-eaddaeb5-8fea-414b-81fb-d827188725d6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:29.279315 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-53314410-1636-4d98-b00f-49285decd7d5 req-5d6b2d05-81f7-44dc-8279-cc842e139495 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:29.280795 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-53314410-1636-4d98-b00f-49285decd7d5 req-5d6b2d05-81f7-44dc-8279-cc842e139495 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:29.282657 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-53314410-1636-4d98-b00f-49285decd7d5 req-5d6b2d05-81f7-44dc-8279-cc842e139495 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:29.285654 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-eaddaeb5-8fea-414b-81fb-d827188725d6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1510 microversion: 2.1 time: 0.305551 Aug 05 20:05:29.289584 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 152/313] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:28 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1510 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:29.333511 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-53314410-1636-4d98-b00f-49285decd7d5 req-5d6b2d05-81f7-44dc-8279-cc842e139495 service nova] Creating event network-vif-plugged:e1afce7c-4bdd-432b-905f-443b0227fa80 for instance 98e6fc07-61b1-455d-8bf0-563c5debbebb on hv-cinder-85221 Aug 05 20:05:29.342322 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-53314410-1636-4d98-b00f-49285decd7d5 req-5d6b2d05-81f7-44dc-8279-cc842e139495 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094251 Aug 05 20:05:29.342990 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 162/314] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:05:29.949593 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-ea51f7ec-fe89-4ceb-a21b-497f754939f1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:29.950204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-ea51f7ec-fe89-4ceb-a21b-497f754939f1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:29.957330 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ea51f7ec-fe89-4ceb-a21b-497f754939f1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:29.957822 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ea51f7ec-fe89-4ceb-a21b-497f754939f1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:29.958255 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ea51f7ec-fe89-4ceb-a21b-497f754939f1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:29.958978 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ea51f7ec-fe89-4ceb-a21b-497f754939f1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:29.959449 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ea51f7ec-fe89-4ceb-a21b-497f754939f1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:29.960119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ea51f7ec-fe89-4ceb-a21b-497f754939f1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:30.129756 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-ea51f7ec-fe89-4ceb-a21b-497f754939f1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:30.146428 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-ea51f7ec-fe89-4ceb-a21b-497f754939f1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:30.148000 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-ea51f7ec-fe89-4ceb-a21b-497f754939f1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:30.149142 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-ea51f7ec-fe89-4ceb-a21b-497f754939f1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.204724 Aug 05 20:05:30.149878 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 153/315] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:29 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:05:30.313553 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-3a04ca43-5304-4bc2-9e06-6c7bfc42b0ca tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:30.314926 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-3a04ca43-5304-4bc2-9e06-6c7bfc42b0ca tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:30.324082 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3a04ca43-5304-4bc2-9e06-6c7bfc42b0ca tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:30.324969 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3a04ca43-5304-4bc2-9e06-6c7bfc42b0ca tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:30.325672 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3a04ca43-5304-4bc2-9e06-6c7bfc42b0ca tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:30.326937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3a04ca43-5304-4bc2-9e06-6c7bfc42b0ca tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:30.327635 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3a04ca43-5304-4bc2-9e06-6c7bfc42b0ca tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:30.328163 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3a04ca43-5304-4bc2-9e06-6c7bfc42b0ca tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:30.469023 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-3a04ca43-5304-4bc2-9e06-6c7bfc42b0ca tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:30.476399 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-3a04ca43-5304-4bc2-9e06-6c7bfc42b0ca tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1510 microversion: 2.1 time: 0.170079 Aug 05 20:05:30.477018 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 163/316] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:30 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:31.172601 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3b1e1569-e2c5-4dca-8bfe-936635c615e1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:31.173328 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-3b1e1569-e2c5-4dca-8bfe-936635c615e1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:31.179896 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3b1e1569-e2c5-4dca-8bfe-936635c615e1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:31.180472 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3b1e1569-e2c5-4dca-8bfe-936635c615e1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:31.181011 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3b1e1569-e2c5-4dca-8bfe-936635c615e1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:31.181721 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3b1e1569-e2c5-4dca-8bfe-936635c615e1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:31.182713 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3b1e1569-e2c5-4dca-8bfe-936635c615e1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:31.183172 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3b1e1569-e2c5-4dca-8bfe-936635c615e1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:31.498913 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-2ed5343c-9e05-4982-9ce5-df55077d342b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:31.500197 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-2ed5343c-9e05-4982-9ce5-df55077d342b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:31.506842 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2ed5343c-9e05-4982-9ce5-df55077d342b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:31.507582 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2ed5343c-9e05-4982-9ce5-df55077d342b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:31.508230 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2ed5343c-9e05-4982-9ce5-df55077d342b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:31.508969 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2ed5343c-9e05-4982-9ce5-df55077d342b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:31.509582 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2ed5343c-9e05-4982-9ce5-df55077d342b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:31.510170 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2ed5343c-9e05-4982-9ce5-df55077d342b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:31.655766 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3b1e1569-e2c5-4dca-8bfe-936635c615e1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:31.668488 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3b1e1569-e2c5-4dca-8bfe-936635c615e1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:31.670719 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3b1e1569-e2c5-4dca-8bfe-936635c615e1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:31.671999 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3b1e1569-e2c5-4dca-8bfe-936635c615e1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.503506 Aug 05 20:05:31.675043 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 154/317] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:31 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:05:31.709867 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-2ed5343c-9e05-4982-9ce5-df55077d342b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:31.718579 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-2ed5343c-9e05-4982-9ce5-df55077d342b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1510 microversion: 2.1 time: 0.224111 Aug 05 20:05:31.719145 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 164/318] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:31 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1510 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:05:32.701932 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-5df44427-55c9-493f-b0c1-90180b4927dc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:32.703381 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-5df44427-55c9-493f-b0c1-90180b4927dc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:32.714411 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5df44427-55c9-493f-b0c1-90180b4927dc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:32.720365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5df44427-55c9-493f-b0c1-90180b4927dc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:32.720959 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5df44427-55c9-493f-b0c1-90180b4927dc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:32.721881 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5df44427-55c9-493f-b0c1-90180b4927dc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:32.722505 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5df44427-55c9-493f-b0c1-90180b4927dc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:32.724164 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5df44427-55c9-493f-b0c1-90180b4927dc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:32.748383 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-2b3c02d0-b2c7-481c-9466-e8cf5bf1f2e7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:32.749879 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-2b3c02d0-b2c7-481c-9466-e8cf5bf1f2e7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:32.771016 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2b3c02d0-b2c7-481c-9466-e8cf5bf1f2e7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:32.771574 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2b3c02d0-b2c7-481c-9466-e8cf5bf1f2e7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:32.772916 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2b3c02d0-b2c7-481c-9466-e8cf5bf1f2e7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:32.776618 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2b3c02d0-b2c7-481c-9466-e8cf5bf1f2e7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:32.777526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2b3c02d0-b2c7-481c-9466-e8cf5bf1f2e7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:32.778200 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2b3c02d0-b2c7-481c-9466-e8cf5bf1f2e7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:32.986753 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-2b3c02d0-b2c7-481c-9466-e8cf5bf1f2e7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:32.995632 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-2b3c02d0-b2c7-481c-9466-e8cf5bf1f2e7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1510 microversion: 2.1 time: 0.253465 Aug 05 20:05:32.996363 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 165/319] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:32 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1510 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:33.001855 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-5df44427-55c9-493f-b0c1-90180b4927dc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:33.011857 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-5df44427-55c9-493f-b0c1-90180b4927dc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:33.013408 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-5df44427-55c9-493f-b0c1-90180b4927dc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:33.014523 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-5df44427-55c9-493f-b0c1-90180b4927dc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.323689 Aug 05 20:05:33.015071 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 155/320] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:32 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:05:34.017288 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-833fcde8-13bf-42df-80a4-2a30944a78ac tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:34.018167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-833fcde8-13bf-42df-80a4-2a30944a78ac tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:34.025011 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-833fcde8-13bf-42df-80a4-2a30944a78ac tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:34.025743 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-833fcde8-13bf-42df-80a4-2a30944a78ac tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:34.026361 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-833fcde8-13bf-42df-80a4-2a30944a78ac tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:34.027238 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-833fcde8-13bf-42df-80a4-2a30944a78ac tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:34.027842 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-833fcde8-13bf-42df-80a4-2a30944a78ac tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:34.028418 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-833fcde8-13bf-42df-80a4-2a30944a78ac tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:34.040756 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-40509ae4-89c3-4e5a-9b79-09a0f34d71a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:34.042114 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-40509ae4-89c3-4e5a-9b79-09a0f34d71a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:34.051325 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-40509ae4-89c3-4e5a-9b79-09a0f34d71a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:34.052317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-40509ae4-89c3-4e5a-9b79-09a0f34d71a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:34.053019 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-40509ae4-89c3-4e5a-9b79-09a0f34d71a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:34.053954 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-40509ae4-89c3-4e5a-9b79-09a0f34d71a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:34.054666 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-40509ae4-89c3-4e5a-9b79-09a0f34d71a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:34.054818 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:34.055920 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-40509ae4-89c3-4e5a-9b79-09a0f34d71a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:34.248238 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-833fcde8-13bf-42df-80a4-2a30944a78ac tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:34.252777 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-40509ae4-89c3-4e5a-9b79-09a0f34d71a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:34.262040 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-40509ae4-89c3-4e5a-9b79-09a0f34d71a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:34.263578 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-40509ae4-89c3-4e5a-9b79-09a0f34d71a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:34.264734 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-40509ae4-89c3-4e5a-9b79-09a0f34d71a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.229913 Aug 05 20:05:34.265831 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 156/321] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:34 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:05:34.273773 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-833fcde8-13bf-42df-80a4-2a30944a78ac tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1510 microversion: 2.1 time: 0.259996 Aug 05 20:05:34.274946 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 166/322] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:34 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1510 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:35.297520 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-53c75960-6063-41a3-90bc-e8c5ce73b4e9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:35.299025 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-53c75960-6063-41a3-90bc-e8c5ce73b4e9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:35.300017 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-eca3f575-02ed-4f54-9d47-0fdcb460844b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:35.301075 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-eca3f575-02ed-4f54-9d47-0fdcb460844b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:35.308700 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53c75960-6063-41a3-90bc-e8c5ce73b4e9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:35.309225 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53c75960-6063-41a3-90bc-e8c5ce73b4e9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:35.310092 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53c75960-6063-41a3-90bc-e8c5ce73b4e9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:35.311151 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53c75960-6063-41a3-90bc-e8c5ce73b4e9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:35.311944 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53c75960-6063-41a3-90bc-e8c5ce73b4e9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:35.312599 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53c75960-6063-41a3-90bc-e8c5ce73b4e9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:35.314149 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eca3f575-02ed-4f54-9d47-0fdcb460844b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:35.327419 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eca3f575-02ed-4f54-9d47-0fdcb460844b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:35.327923 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eca3f575-02ed-4f54-9d47-0fdcb460844b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:35.328722 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eca3f575-02ed-4f54-9d47-0fdcb460844b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:35.329380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eca3f575-02ed-4f54-9d47-0fdcb460844b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:35.329972 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eca3f575-02ed-4f54-9d47-0fdcb460844b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:35.574376 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-eca3f575-02ed-4f54-9d47-0fdcb460844b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:35.606199 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-eca3f575-02ed-4f54-9d47-0fdcb460844b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:35.608390 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-eca3f575-02ed-4f54-9d47-0fdcb460844b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:35.609785 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-eca3f575-02ed-4f54-9d47-0fdcb460844b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.325968 Aug 05 20:05:35.610362 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 157/323] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:35 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:05:35.639133 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-53c75960-6063-41a3-90bc-e8c5ce73b4e9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:35.648000 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-53c75960-6063-41a3-90bc-e8c5ce73b4e9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1510 microversion: 2.1 time: 0.355704 Aug 05 20:05:35.648603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 167/324] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:35 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1510 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:05:36.636007 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-fc2e8a1b-74a7-42cd-aa6c-f913b39f8ce5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:36.636680 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-fc2e8a1b-74a7-42cd-aa6c-f913b39f8ce5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:36.643365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc2e8a1b-74a7-42cd-aa6c-f913b39f8ce5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:36.643847 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc2e8a1b-74a7-42cd-aa6c-f913b39f8ce5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:36.644304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc2e8a1b-74a7-42cd-aa6c-f913b39f8ce5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:36.645023 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc2e8a1b-74a7-42cd-aa6c-f913b39f8ce5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:36.645472 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc2e8a1b-74a7-42cd-aa6c-f913b39f8ce5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:36.645891 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc2e8a1b-74a7-42cd-aa6c-f913b39f8ce5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:36.671675 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-76416e7c-072f-425f-8e8b-ef47c7ca8de3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:36.673363 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-76416e7c-072f-425f-8e8b-ef47c7ca8de3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:36.684378 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-76416e7c-072f-425f-8e8b-ef47c7ca8de3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:36.685171 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-76416e7c-072f-425f-8e8b-ef47c7ca8de3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:36.685784 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-76416e7c-072f-425f-8e8b-ef47c7ca8de3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:36.686983 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-76416e7c-072f-425f-8e8b-ef47c7ca8de3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:36.687599 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-76416e7c-072f-425f-8e8b-ef47c7ca8de3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:36.688184 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-76416e7c-072f-425f-8e8b-ef47c7ca8de3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:36.921641 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-fc2e8a1b-74a7-42cd-aa6c-f913b39f8ce5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:36.929928 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-fc2e8a1b-74a7-42cd-aa6c-f913b39f8ce5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:36.936456 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-fc2e8a1b-74a7-42cd-aa6c-f913b39f8ce5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:36.937864 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-fc2e8a1b-74a7-42cd-aa6c-f913b39f8ce5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.306409 Aug 05 20:05:36.939736 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 158/325] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:36 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:05:36.959536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-76416e7c-072f-425f-8e8b-ef47c7ca8de3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:36.980172 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-76416e7c-072f-425f-8e8b-ef47c7ca8de3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1510 microversion: 2.1 time: 0.312644 Aug 05 20:05:36.981038 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 168/326] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:36 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1510 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:37.967064 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-bdc832b6-74ca-4898-8bff-8ad4756063b4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:37.968298 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-bdc832b6-74ca-4898-8bff-8ad4756063b4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:37.977103 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bdc832b6-74ca-4898-8bff-8ad4756063b4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:37.977834 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bdc832b6-74ca-4898-8bff-8ad4756063b4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:37.978431 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bdc832b6-74ca-4898-8bff-8ad4756063b4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:37.979842 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bdc832b6-74ca-4898-8bff-8ad4756063b4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:37.981962 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bdc832b6-74ca-4898-8bff-8ad4756063b4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:37.982574 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bdc832b6-74ca-4898-8bff-8ad4756063b4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:38.001749 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-74637ffe-a33a-4a71-af01-172a1cf939bc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:38.003259 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-74637ffe-a33a-4a71-af01-172a1cf939bc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:38.010422 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-74637ffe-a33a-4a71-af01-172a1cf939bc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:38.011243 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-74637ffe-a33a-4a71-af01-172a1cf939bc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:38.011946 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-74637ffe-a33a-4a71-af01-172a1cf939bc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:38.012929 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-74637ffe-a33a-4a71-af01-172a1cf939bc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:38.013663 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-74637ffe-a33a-4a71-af01-172a1cf939bc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:38.014281 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-74637ffe-a33a-4a71-af01-172a1cf939bc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:38.332484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-bdc832b6-74ca-4898-8bff-8ad4756063b4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:38.337645 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-74637ffe-a33a-4a71-af01-172a1cf939bc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:38.348384 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-bdc832b6-74ca-4898-8bff-8ad4756063b4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:38.350233 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-bdc832b6-74ca-4898-8bff-8ad4756063b4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:38.350389 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-74637ffe-a33a-4a71-af01-172a1cf939bc tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1510 microversion: 2.1 time: 0.350392 Aug 05 20:05:38.351678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-bdc832b6-74ca-4898-8bff-8ad4756063b4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.389120 Aug 05 20:05:38.352253 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 159/327] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:37 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:05:38.352766 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 169/328] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:37 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1510 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:05:39.377575 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-3b46f481-976d-4798-9860-ca237c5ef7e5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:39.379224 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-c9e8c41c-7eef-454e-be3f-8be18c16364d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:39.379848 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-c9e8c41c-7eef-454e-be3f-8be18c16364d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:39.380011 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-3b46f481-976d-4798-9860-ca237c5ef7e5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:39.386802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3b46f481-976d-4798-9860-ca237c5ef7e5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:39.387094 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c9e8c41c-7eef-454e-be3f-8be18c16364d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:39.387290 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3b46f481-976d-4798-9860-ca237c5ef7e5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:39.387584 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c9e8c41c-7eef-454e-be3f-8be18c16364d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:39.387709 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3b46f481-976d-4798-9860-ca237c5ef7e5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:39.388017 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c9e8c41c-7eef-454e-be3f-8be18c16364d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:39.388413 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3b46f481-976d-4798-9860-ca237c5ef7e5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:39.388804 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c9e8c41c-7eef-454e-be3f-8be18c16364d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:39.388914 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3b46f481-976d-4798-9860-ca237c5ef7e5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:39.389260 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c9e8c41c-7eef-454e-be3f-8be18c16364d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:39.389368 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3b46f481-976d-4798-9860-ca237c5ef7e5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:39.389684 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c9e8c41c-7eef-454e-be3f-8be18c16364d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:39.658455 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-3b46f481-976d-4798-9860-ca237c5ef7e5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:39.672197 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-3b46f481-976d-4798-9860-ca237c5ef7e5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1510 microversion: 2.1 time: 0.297309 Aug 05 20:05:39.675245 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 170/329] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:39 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1510 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:39.727663 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-c9e8c41c-7eef-454e-be3f-8be18c16364d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:39.741512 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-c9e8c41c-7eef-454e-be3f-8be18c16364d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:39.743341 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-c9e8c41c-7eef-454e-be3f-8be18c16364d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:39.746631 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-c9e8c41c-7eef-454e-be3f-8be18c16364d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1408 microversion: 2.20 time: 0.372751 Aug 05 20:05:39.760656 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 160/330] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:39 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1408 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:05:40.700249 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-2777a4d9-06a6-411d-a890-e2ca49c600fa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:40.701121 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-2777a4d9-06a6-411d-a890-e2ca49c600fa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:40.723174 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2777a4d9-06a6-411d-a890-e2ca49c600fa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:40.724874 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2777a4d9-06a6-411d-a890-e2ca49c600fa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:40.730020 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2777a4d9-06a6-411d-a890-e2ca49c600fa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:40.733291 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2777a4d9-06a6-411d-a890-e2ca49c600fa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:40.734578 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2777a4d9-06a6-411d-a890-e2ca49c600fa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:40.735691 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2777a4d9-06a6-411d-a890-e2ca49c600fa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:40.771981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7d3093b4-c771-4deb-86bd-d3db7ef8c3a2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:40.772889 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-7d3093b4-c771-4deb-86bd-d3db7ef8c3a2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:40.793931 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7d3093b4-c771-4deb-86bd-d3db7ef8c3a2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:40.797156 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7d3093b4-c771-4deb-86bd-d3db7ef8c3a2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:40.797730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7d3093b4-c771-4deb-86bd-d3db7ef8c3a2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:40.798566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7d3093b4-c771-4deb-86bd-d3db7ef8c3a2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:40.802447 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7d3093b4-c771-4deb-86bd-d3db7ef8c3a2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:40.803880 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7d3093b4-c771-4deb-86bd-d3db7ef8c3a2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:41.004750 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-2777a4d9-06a6-411d-a890-e2ca49c600fa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:41.016824 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-2777a4d9-06a6-411d-a890-e2ca49c600fa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1510 microversion: 2.1 time: 0.324837 Aug 05 20:05:41.018178 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 171/331] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:40 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1510 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:41.125775 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-7d3093b4-c771-4deb-86bd-d3db7ef8c3a2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:41.144039 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-7d3093b4-c771-4deb-86bd-d3db7ef8c3a2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:41.147614 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-7d3093b4-c771-4deb-86bd-d3db7ef8c3a2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:41.153106 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-7d3093b4-c771-4deb-86bd-d3db7ef8c3a2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1600 microversion: 2.20 time: 0.381825 Aug 05 20:05:41.168635 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 161/332] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:05:40 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1600 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:05:41.181277 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b2282791-9ff3-4d18-b4c0-56408ea38a9b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:41.181277 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-b2282791-9ff3-4d18-b4c0-56408ea38a9b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:41.187915 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b2282791-9ff3-4d18-b4c0-56408ea38a9b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:41.190928 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b2282791-9ff3-4d18-b4c0-56408ea38a9b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:41.193267 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b2282791-9ff3-4d18-b4c0-56408ea38a9b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:41.199279 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b2282791-9ff3-4d18-b4c0-56408ea38a9b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:41.200673 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b2282791-9ff3-4d18-b4c0-56408ea38a9b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:41.201337 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b2282791-9ff3-4d18-b4c0-56408ea38a9b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:41.307497 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b2282791-9ff3-4d18-b4c0-56408ea38a9b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.131386 Aug 05 20:05:41.315048 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 172/333] 10.222.0.39 () {60 vars in 1316 bytes} [Fri Aug 5 20:05:41 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:05:41.767148 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-65000523-3fdc-48f1-868c-592283c08eb7 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Action: 'create', calling method: .version_select at 0x7fe3e637d670>, body: {"keypair": {"name": "tempest-TestShelveInstance-1038104014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/JpHkTkimWk8RiaN08tvkkozDCE5Z+aQoHQDa8TeowOL9Grp5G3rE0RsNMvxdvvbX5wACIdcYMPasPvbtS/XMdfiubN8yNxrHa+wESkD33WKT2nUfMDaYkNbcZY+UZ7Q=="}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:05:41.815980 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-65000523-3fdc-48f1-868c-592283c08eb7 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Getting quotas for project 3f8a529448f14ef18a72de884f17d0f6. Resources: {'key_pairs'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:05:41.820655 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-65000523-3fdc-48f1-868c-592283c08eb7 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Getting quotas for user 0e022456457d41b8812058252e4a43f4 and project 3f8a529448f14ef18a72de884f17d0f6. Resources: {'key_pairs'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:05:41.898093 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-65000523-3fdc-48f1-868c-592283c08eb7 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.405666 Aug 05 20:05:41.901975 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 162/334] 10.222.0.39 () {60 vars in 1159 bytes} [Fri Aug 5 20:05:41 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:05:42.046740 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-65ca112d-3875-4030-8351-07e4e984e447 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:42.047370 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-65ca112d-3875-4030-8351-07e4e984e447 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:42.062281 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-65ca112d-3875-4030-8351-07e4e984e447 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:42.062986 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-65ca112d-3875-4030-8351-07e4e984e447 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:42.064204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-65ca112d-3875-4030-8351-07e4e984e447 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:42.065813 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-65ca112d-3875-4030-8351-07e4e984e447 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:42.066441 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-65ca112d-3875-4030-8351-07e4e984e447 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:42.066872 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-65ca112d-3875-4030-8351-07e4e984e447 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:42.355322 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-65ca112d-3875-4030-8351-07e4e984e447 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:42.365827 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-65ca112d-3875-4030-8351-07e4e984e447 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1516 microversion: 2.1 time: 0.326306 Aug 05 20:05:42.367258 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 173/335] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:42 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1516 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:42.902569 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-45e7d3a9-2ec1-4444-abf1-203f2dd0385f req-aa640a81-b27b-4629-a425-ed44f17c8660 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98e6fc07-61b1-455d-8bf0-563c5debbebb", "tag": "e1afce7c-4bdd-432b-905f-443b0227fa80"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:05:42.930528 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-45e7d3a9-2ec1-4444-abf1-203f2dd0385f req-aa640a81-b27b-4629-a425-ed44f17c8660 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:42.932514 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-45e7d3a9-2ec1-4444-abf1-203f2dd0385f req-aa640a81-b27b-4629-a425-ed44f17c8660 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:42.938167 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-45e7d3a9-2ec1-4444-abf1-203f2dd0385f req-aa640a81-b27b-4629-a425-ed44f17c8660 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:42.955795 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-45e7d3a9-2ec1-4444-abf1-203f2dd0385f req-aa640a81-b27b-4629-a425-ed44f17c8660 service nova] Creating event network-changed:e1afce7c-4bdd-432b-905f-443b0227fa80 for instance 98e6fc07-61b1-455d-8bf0-563c5debbebb on hv-cinder-85221 Aug 05 20:05:42.976851 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-45e7d3a9-2ec1-4444-abf1-203f2dd0385f req-aa640a81-b27b-4629-a425-ed44f17c8660 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080094 Aug 05 20:05:42.977616 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 163/336] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:05:51.565285 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-aad78183-d545-4120-a3de-384969f81d79 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Action: 'create', calling method: .version_select at 0x7fe3e46b6c10>, body: {"keypair": {"name": "tempest-keypair-1200964215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoPecITvqrSyCR1ZRpuuDL06skt7yttP0WOH4OGROjQFFl0egNLY4Zin0T2YawYoWnLPjEmdziRjgc3jeBDRW3+ZlIP18eJnjM5fI51K3J1xe0zOFzOG1WZK6w+f8YzCQ=="}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:05:51.575155 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=46 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:51.585473 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-aad78183-d545-4120-a3de-384969f81d79 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Getting quotas for project c5b5718607784ec9be3289f7916f70a6. Resources: {'key_pairs'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:05:51.595686 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-aad78183-d545-4120-a3de-384969f81d79 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Getting quotas for user 293b8a62f19c45c1bf5b897c7cf40edb and project c5b5718607784ec9be3289f7916f70a6. Resources: {'key_pairs'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:05:51.623256 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-aad78183-d545-4120-a3de-384969f81d79 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.062216 Aug 05 20:05:51.624355 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 174/337] 10.222.0.39 () {60 vars in 1159 bytes} [Fri Aug 5 20:05:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:05:53.029934 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-748da4e2-16d7-46f6-bfcc-6c644e860e5c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-830281156", "imageRef": "c148255e-9574-4d10-b9bb-13c9411eda77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "32e23f54-487d-4a73-8ea1-6e99e83c698e"}], "security_groups": [{"name": "tempest-securitygroup--2120710171"}], "key_name": "tempest-keypair-1200964215", "user_data": "}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:05:53.037950 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=4 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:53.038619 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:53.039520 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=91 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:53.141255 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.network.neutron [None req-748da4e2-16d7-46f6-bfcc-6c644e860e5c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] validate_networks() for [('32e23f54-487d-4a73-8ea1-6e99e83c698e', None, None, None, None, None)] {{(pid=118191) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:05:53.517427 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-748da4e2-16d7-46f6-bfcc-6c644e860e5c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Flavor limits 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:05:53.517886 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-748da4e2-16d7-46f6-bfcc-6c644e860e5c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Image limits 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:05:53.518375 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-748da4e2-16d7-46f6-bfcc-6c644e860e5c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Flavor pref 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:05:53.518785 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-748da4e2-16d7-46f6-bfcc-6c644e860e5c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Image pref 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:05:53.519325 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-748da4e2-16d7-46f6-bfcc-6c644e860e5c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:05:53.528605 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-748da4e2-16d7-46f6-bfcc-6c644e860e5c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:53.529289 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-748da4e2-16d7-46f6-bfcc-6c644e860e5c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:53.529887 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-748da4e2-16d7-46f6-bfcc-6c644e860e5c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:53.530607 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-748da4e2-16d7-46f6-bfcc-6c644e860e5c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:53.531058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-748da4e2-16d7-46f6-bfcc-6c644e860e5c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:53.531478 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-748da4e2-16d7-46f6-bfcc-6c644e860e5c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:53.548389 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-748da4e2-16d7-46f6-bfcc-6c644e860e5c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Getting quotas for project c5b5718607784ec9be3289f7916f70a6. Resources: {'cores', 'ram', 'instances'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:05:53.552474 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-748da4e2-16d7-46f6-bfcc-6c644e860e5c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Getting quotas for user 293b8a62f19c45c1bf5b897c7cf40edb and project c5b5718607784ec9be3289f7916f70a6. Resources: {'cores', 'ram', 'instances'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:05:53.563214 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-748da4e2-16d7-46f6-bfcc-6c644e860e5c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Going to run 1 instances... {{(pid=118191) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:05:53.565735 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-748da4e2-16d7-46f6-bfcc-6c644e860e5c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c148255e-9574-4d10-b9bb-13c9411eda77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118191) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:05:53.616777 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-748da4e2-16d7-46f6-bfcc-6c644e860e5c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.592393 Aug 05 20:05:53.617415 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 164/338] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Aug 5 20:05:53 2022] POST /compute/v2.1/servers => generated 409 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:05:53.625162 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=43 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:05:53.629587 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-f9db126d-c6e0-48a6-a7aa-b7c0f68e0ad7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:53.630196 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-f9db126d-c6e0-48a6-a7aa-b7c0f68e0ad7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:53.694346 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-f9db126d-c6e0-48a6-a7aa-b7c0f68e0ad7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:53.705475 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-f9db126d-c6e0-48a6-a7aa-b7c0f68e0ad7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1245 microversion: 2.1 time: 0.080787 Aug 05 20:05:53.705951 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 175/339] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:53 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:54.729412 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-cd857287-ef6b-4013-ae9d-57c30ed8ae54 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:54.730024 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-cd857287-ef6b-4013-ae9d-57c30ed8ae54 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:54.785829 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-cd857287-ef6b-4013-ae9d-57c30ed8ae54 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:54.794009 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-cd857287-ef6b-4013-ae9d-57c30ed8ae54 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1245 microversion: 2.1 time: 0.069087 Aug 05 20:05:54.794573 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 165/340] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:54 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1245 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:55.814826 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-c8be57dc-86c5-49be-a92a-18069d65e1fa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:55.815436 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-c8be57dc-86c5-49be-a92a-18069d65e1fa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:55.867246 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-c8be57dc-86c5-49be-a92a-18069d65e1fa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:55.875171 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-c8be57dc-86c5-49be-a92a-18069d65e1fa tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1245 microversion: 2.1 time: 0.064159 Aug 05 20:05:55.875964 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 176/341] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:55 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1245 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:56.901078 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7b973a5a-a5c7-4507-b14c-dbfe9a366b73 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:56.901693 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-7b973a5a-a5c7-4507-b14c-dbfe9a366b73 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:56.909013 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7b973a5a-a5c7-4507-b14c-dbfe9a366b73 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:56.909500 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7b973a5a-a5c7-4507-b14c-dbfe9a366b73 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:56.909932 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7b973a5a-a5c7-4507-b14c-dbfe9a366b73 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:56.910628 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7b973a5a-a5c7-4507-b14c-dbfe9a366b73 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:56.911077 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7b973a5a-a5c7-4507-b14c-dbfe9a366b73 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:56.911500 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7b973a5a-a5c7-4507-b14c-dbfe9a366b73 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:56.973898 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-7b973a5a-a5c7-4507-b14c-dbfe9a366b73 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:56.982613 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-7b973a5a-a5c7-4507-b14c-dbfe9a366b73 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1249 microversion: 2.1 time: 0.089672 Aug 05 20:05:56.983183 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 166/342] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:56 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1249 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:58.003299 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-f2626164-b2d9-4bc7-bb81-74c5bbe5df37 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:58.003916 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-f2626164-b2d9-4bc7-bb81-74c5bbe5df37 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:58.010978 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f2626164-b2d9-4bc7-bb81-74c5bbe5df37 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:58.011473 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f2626164-b2d9-4bc7-bb81-74c5bbe5df37 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:58.011918 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f2626164-b2d9-4bc7-bb81-74c5bbe5df37 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:58.012643 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f2626164-b2d9-4bc7-bb81-74c5bbe5df37 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:58.013107 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f2626164-b2d9-4bc7-bb81-74c5bbe5df37 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:58.013538 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f2626164-b2d9-4bc7-bb81-74c5bbe5df37 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:58.077455 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-f2626164-b2d9-4bc7-bb81-74c5bbe5df37 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:58.084985 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-f2626164-b2d9-4bc7-bb81-74c5bbe5df37 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1297 microversion: 2.1 time: 0.085426 Aug 05 20:05:58.085546 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 177/343] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:57 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:05:59.107866 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-08e6804a-80e0-47e4-9144-9878e6e1009b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:05:59.108466 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-08e6804a-80e0-47e4-9144-9878e6e1009b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:05:59.114979 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-08e6804a-80e0-47e4-9144-9878e6e1009b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:59.115468 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-08e6804a-80e0-47e4-9144-9878e6e1009b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:59.115908 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-08e6804a-80e0-47e4-9144-9878e6e1009b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:59.116671 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-08e6804a-80e0-47e4-9144-9878e6e1009b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:05:59.117123 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-08e6804a-80e0-47e4-9144-9878e6e1009b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:05:59.117542 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-08e6804a-80e0-47e4-9144-9878e6e1009b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:05:59.186460 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-08e6804a-80e0-47e4-9144-9878e6e1009b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:05:59.194138 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-08e6804a-80e0-47e4-9144-9878e6e1009b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1303 microversion: 2.1 time: 0.091589 Aug 05 20:05:59.194853 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 167/344] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:05:59 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:00.216750 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-fed0db5a-7bf2-4f48-b824-36685f8405ec tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:00.217301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-fed0db5a-7bf2-4f48-b824-36685f8405ec tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:00.223668 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fed0db5a-7bf2-4f48-b824-36685f8405ec tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:00.224155 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fed0db5a-7bf2-4f48-b824-36685f8405ec tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:00.224620 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fed0db5a-7bf2-4f48-b824-36685f8405ec tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:00.225372 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fed0db5a-7bf2-4f48-b824-36685f8405ec tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:00.225826 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fed0db5a-7bf2-4f48-b824-36685f8405ec tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:00.226253 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fed0db5a-7bf2-4f48-b824-36685f8405ec tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:00.355122 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-fed0db5a-7bf2-4f48-b824-36685f8405ec tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:00.362444 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-fed0db5a-7bf2-4f48-b824-36685f8405ec tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.150512 Aug 05 20:06:00.363005 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 178/345] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:00 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:01.384217 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-2ddbd10c-cdbe-4d72-9f18-3c82df953843 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:01.384893 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-2ddbd10c-cdbe-4d72-9f18-3c82df953843 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:01.392309 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2ddbd10c-cdbe-4d72-9f18-3c82df953843 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:01.392827 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2ddbd10c-cdbe-4d72-9f18-3c82df953843 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:01.393271 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2ddbd10c-cdbe-4d72-9f18-3c82df953843 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:01.394025 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2ddbd10c-cdbe-4d72-9f18-3c82df953843 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:01.394426 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2ddbd10c-cdbe-4d72-9f18-3c82df953843 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:01.394853 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2ddbd10c-cdbe-4d72-9f18-3c82df953843 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:01.529608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-2ddbd10c-cdbe-4d72-9f18-3c82df953843 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:01.537003 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-2ddbd10c-cdbe-4d72-9f18-3c82df953843 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.156676 Aug 05 20:06:01.537584 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 168/346] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:01 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:02.557760 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-25bf7658-69a4-4387-955f-fa83d6254856 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:02.558375 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-25bf7658-69a4-4387-955f-fa83d6254856 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:02.564906 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-25bf7658-69a4-4387-955f-fa83d6254856 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:02.565380 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-25bf7658-69a4-4387-955f-fa83d6254856 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:02.565817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-25bf7658-69a4-4387-955f-fa83d6254856 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:02.566505 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-25bf7658-69a4-4387-955f-fa83d6254856 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:02.566960 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-25bf7658-69a4-4387-955f-fa83d6254856 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:02.567385 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-25bf7658-69a4-4387-955f-fa83d6254856 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:02.693924 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-25bf7658-69a4-4387-955f-fa83d6254856 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:02.702139 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-25bf7658-69a4-4387-955f-fa83d6254856 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.148483 Aug 05 20:06:02.702705 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 179/347] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:02 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:03.722507 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=2 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:03.726656 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-35816e63-8018-4946-807e-c02cefd6a3a4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:03.727271 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-35816e63-8018-4946-807e-c02cefd6a3a4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:03.733688 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-35816e63-8018-4946-807e-c02cefd6a3a4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:03.734169 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-35816e63-8018-4946-807e-c02cefd6a3a4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:03.734600 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-35816e63-8018-4946-807e-c02cefd6a3a4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:03.735286 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-35816e63-8018-4946-807e-c02cefd6a3a4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:03.735733 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-35816e63-8018-4946-807e-c02cefd6a3a4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:03.736154 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-35816e63-8018-4946-807e-c02cefd6a3a4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:03.882100 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-35816e63-8018-4946-807e-c02cefd6a3a4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:03.890620 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-35816e63-8018-4946-807e-c02cefd6a3a4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.169606 Aug 05 20:06:03.903544 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 169/348] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:03 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:04.093424 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-c4e9a728-24c0-41d6-9bd1-6592a2936620 req-9e705f00-3616-4316-9f07-71b37f1b34c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1", "tag": "780a6046-5a34-4fe1-b8f7-b847e0fc78b0"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:06:04.102964 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-c4e9a728-24c0-41d6-9bd1-6592a2936620 req-9e705f00-3616-4316-9f07-71b37f1b34c8 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:04.103484 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-c4e9a728-24c0-41d6-9bd1-6592a2936620 req-9e705f00-3616-4316-9f07-71b37f1b34c8 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:04.104045 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-c4e9a728-24c0-41d6-9bd1-6592a2936620 req-9e705f00-3616-4316-9f07-71b37f1b34c8 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:04.114592 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-c4e9a728-24c0-41d6-9bd1-6592a2936620 req-9e705f00-3616-4316-9f07-71b37f1b34c8 service nova] Creating event network-changed:780a6046-5a34-4fe1-b8f7-b847e0fc78b0 for instance 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 on hv-cinder-85221 Aug 05 20:06:04.121816 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-c4e9a728-24c0-41d6-9bd1-6592a2936620 req-9e705f00-3616-4316-9f07-71b37f1b34c8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031497 Aug 05 20:06:04.122633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 180/349] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:06:04.917957 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-1745b3b1-9296-44ca-869a-8b7ff8df058e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:04.918723 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-1745b3b1-9296-44ca-869a-8b7ff8df058e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:04.921168 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=8 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:04.926625 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1745b3b1-9296-44ca-869a-8b7ff8df058e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:04.927106 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1745b3b1-9296-44ca-869a-8b7ff8df058e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:04.927533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1745b3b1-9296-44ca-869a-8b7ff8df058e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:04.928224 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1745b3b1-9296-44ca-869a-8b7ff8df058e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:04.928700 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1745b3b1-9296-44ca-869a-8b7ff8df058e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:04.929122 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1745b3b1-9296-44ca-869a-8b7ff8df058e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:05.061806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-1745b3b1-9296-44ca-869a-8b7ff8df058e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:05.069322 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-1745b3b1-9296-44ca-869a-8b7ff8df058e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.158260 Aug 05 20:06:05.069884 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 170/350] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:04 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:06.088606 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell0:SELECT=8 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:06.094179 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ddaf2aaa-1469-4f0a-9fc5-a75b0fea8d0f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:06.094889 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-ddaf2aaa-1469-4f0a-9fc5-a75b0fea8d0f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:06.102161 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ddaf2aaa-1469-4f0a-9fc5-a75b0fea8d0f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:06.102630 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ddaf2aaa-1469-4f0a-9fc5-a75b0fea8d0f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:06.103073 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ddaf2aaa-1469-4f0a-9fc5-a75b0fea8d0f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:06.104944 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ddaf2aaa-1469-4f0a-9fc5-a75b0fea8d0f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:06.105580 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ddaf2aaa-1469-4f0a-9fc5-a75b0fea8d0f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:06.106177 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ddaf2aaa-1469-4f0a-9fc5-a75b0fea8d0f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:06.243444 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-ddaf2aaa-1469-4f0a-9fc5-a75b0fea8d0f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:06.251505 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-ddaf2aaa-1469-4f0a-9fc5-a75b0fea8d0f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.164835 Aug 05 20:06:06.252061 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 181/351] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:06 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:07.272642 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-bdf42e86-5413-46a9-8556-0a4ab40b8f4b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:07.273257 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-bdf42e86-5413-46a9-8556-0a4ab40b8f4b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:07.279732 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bdf42e86-5413-46a9-8556-0a4ab40b8f4b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:07.280215 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bdf42e86-5413-46a9-8556-0a4ab40b8f4b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:07.280675 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bdf42e86-5413-46a9-8556-0a4ab40b8f4b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:07.281367 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bdf42e86-5413-46a9-8556-0a4ab40b8f4b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:07.281821 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bdf42e86-5413-46a9-8556-0a4ab40b8f4b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:07.282248 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bdf42e86-5413-46a9-8556-0a4ab40b8f4b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:07.430215 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-bdf42e86-5413-46a9-8556-0a4ab40b8f4b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:07.438560 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-bdf42e86-5413-46a9-8556-0a4ab40b8f4b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.169705 Aug 05 20:06:07.441089 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 171/352] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:07 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:08.460747 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-c26a0c8c-57c7-4a87-a35b-1e4bea21f90b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:08.461364 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-c26a0c8c-57c7-4a87-a35b-1e4bea21f90b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:08.468753 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c26a0c8c-57c7-4a87-a35b-1e4bea21f90b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:08.469246 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c26a0c8c-57c7-4a87-a35b-1e4bea21f90b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:08.469686 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c26a0c8c-57c7-4a87-a35b-1e4bea21f90b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:08.470403 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c26a0c8c-57c7-4a87-a35b-1e4bea21f90b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:08.470858 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c26a0c8c-57c7-4a87-a35b-1e4bea21f90b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:08.471281 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c26a0c8c-57c7-4a87-a35b-1e4bea21f90b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:08.605179 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-c26a0c8c-57c7-4a87-a35b-1e4bea21f90b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:08.612650 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-c26a0c8c-57c7-4a87-a35b-1e4bea21f90b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.155664 Aug 05 20:06:08.613320 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 182/353] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:08 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:09.636362 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-cf119779-6f34-4cf9-b8cb-8e97f971a894 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:09.636362 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-cf119779-6f34-4cf9-b8cb-8e97f971a894 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:09.640416 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cf119779-6f34-4cf9-b8cb-8e97f971a894 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:09.640936 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cf119779-6f34-4cf9-b8cb-8e97f971a894 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:09.641371 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cf119779-6f34-4cf9-b8cb-8e97f971a894 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:09.642376 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cf119779-6f34-4cf9-b8cb-8e97f971a894 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:09.642830 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cf119779-6f34-4cf9-b8cb-8e97f971a894 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:09.643255 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cf119779-6f34-4cf9-b8cb-8e97f971a894 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:09.774454 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-cf119779-6f34-4cf9-b8cb-8e97f971a894 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:09.781948 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-cf119779-6f34-4cf9-b8cb-8e97f971a894 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.152610 Aug 05 20:06:09.782519 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 172/354] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:09 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:10.803030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-064ee306-d7e3-4933-b0aa-e09ee3742169 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:10.803595 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-064ee306-d7e3-4933-b0aa-e09ee3742169 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:10.810706 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-064ee306-d7e3-4933-b0aa-e09ee3742169 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:10.811193 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-064ee306-d7e3-4933-b0aa-e09ee3742169 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:10.811628 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-064ee306-d7e3-4933-b0aa-e09ee3742169 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:10.812353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-064ee306-d7e3-4933-b0aa-e09ee3742169 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:10.812837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-064ee306-d7e3-4933-b0aa-e09ee3742169 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:10.813268 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-064ee306-d7e3-4933-b0aa-e09ee3742169 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:11.154877 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-064ee306-d7e3-4933-b0aa-e09ee3742169 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:11.162168 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-064ee306-d7e3-4933-b0aa-e09ee3742169 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.363032 Aug 05 20:06:11.162724 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 183/355] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:10 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:12.183819 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-383974fb-6f89-43a1-acff-06f8ee665eea tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:12.184461 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-383974fb-6f89-43a1-acff-06f8ee665eea tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:12.191034 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-383974fb-6f89-43a1-acff-06f8ee665eea tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:12.191524 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-383974fb-6f89-43a1-acff-06f8ee665eea tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:12.191967 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-383974fb-6f89-43a1-acff-06f8ee665eea tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:12.192707 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-383974fb-6f89-43a1-acff-06f8ee665eea tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:12.193164 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-383974fb-6f89-43a1-acff-06f8ee665eea tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:12.193588 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-383974fb-6f89-43a1-acff-06f8ee665eea tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:12.335622 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-383974fb-6f89-43a1-acff-06f8ee665eea tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:12.346777 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-383974fb-6f89-43a1-acff-06f8ee665eea tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.167320 Aug 05 20:06:12.347343 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 173/356] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:12 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:13.369420 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-eba09872-8b55-442e-81a8-e740c5633457 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:13.370144 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-eba09872-8b55-442e-81a8-e740c5633457 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:13.377835 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eba09872-8b55-442e-81a8-e740c5633457 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:13.378327 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eba09872-8b55-442e-81a8-e740c5633457 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:13.378759 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eba09872-8b55-442e-81a8-e740c5633457 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:13.379515 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eba09872-8b55-442e-81a8-e740c5633457 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:13.379963 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eba09872-8b55-442e-81a8-e740c5633457 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:13.380385 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eba09872-8b55-442e-81a8-e740c5633457 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:13.528006 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-eba09872-8b55-442e-81a8-e740c5633457 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:13.534367 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-eba09872-8b55-442e-81a8-e740c5633457 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.169555 Aug 05 20:06:13.534941 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 184/357] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:13 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:14.555064 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7273efdd-31d5-45dc-959c-92b60df7c926 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:14.555700 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-7273efdd-31d5-45dc-959c-92b60df7c926 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:14.561905 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7273efdd-31d5-45dc-959c-92b60df7c926 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:14.562384 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7273efdd-31d5-45dc-959c-92b60df7c926 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:14.562815 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7273efdd-31d5-45dc-959c-92b60df7c926 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:14.563494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7273efdd-31d5-45dc-959c-92b60df7c926 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:14.563942 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7273efdd-31d5-45dc-959c-92b60df7c926 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:14.564363 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7273efdd-31d5-45dc-959c-92b60df7c926 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:14.693493 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-7273efdd-31d5-45dc-959c-92b60df7c926 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:14.701712 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-7273efdd-31d5-45dc-959c-92b60df7c926 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.150517 Aug 05 20:06:14.702278 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 174/358] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:14 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:15.723068 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-2740bbae-0f38-4a5d-9a9e-cbe86ffe4cb7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:15.723686 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-2740bbae-0f38-4a5d-9a9e-cbe86ffe4cb7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:15.730149 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2740bbae-0f38-4a5d-9a9e-cbe86ffe4cb7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:15.730635 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2740bbae-0f38-4a5d-9a9e-cbe86ffe4cb7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:15.731074 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2740bbae-0f38-4a5d-9a9e-cbe86ffe4cb7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:15.731770 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2740bbae-0f38-4a5d-9a9e-cbe86ffe4cb7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:15.732224 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2740bbae-0f38-4a5d-9a9e-cbe86ffe4cb7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:15.732678 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2740bbae-0f38-4a5d-9a9e-cbe86ffe4cb7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:15.864165 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-2740bbae-0f38-4a5d-9a9e-cbe86ffe4cb7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:15.872153 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-2740bbae-0f38-4a5d-9a9e-cbe86ffe4cb7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.152951 Aug 05 20:06:15.872731 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 185/359] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:15 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:16.893685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a1e09582-5696-4f49-b8a1-7b46ea52e056 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:16.894293 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-a1e09582-5696-4f49-b8a1-7b46ea52e056 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:16.901356 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a1e09582-5696-4f49-b8a1-7b46ea52e056 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:16.901944 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a1e09582-5696-4f49-b8a1-7b46ea52e056 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:16.902447 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a1e09582-5696-4f49-b8a1-7b46ea52e056 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:16.903271 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a1e09582-5696-4f49-b8a1-7b46ea52e056 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:16.903769 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a1e09582-5696-4f49-b8a1-7b46ea52e056 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:16.904286 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a1e09582-5696-4f49-b8a1-7b46ea52e056 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:17.034038 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a1e09582-5696-4f49-b8a1-7b46ea52e056 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:17.041607 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-a1e09582-5696-4f49-b8a1-7b46ea52e056 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.152307 Aug 05 20:06:17.042176 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 175/360] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:16 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:18.061423 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-c077bc80-2a06-4294-9600-4b74d1cd7d33 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:18.061960 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-c077bc80-2a06-4294-9600-4b74d1cd7d33 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:18.068262 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c077bc80-2a06-4294-9600-4b74d1cd7d33 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:18.068792 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c077bc80-2a06-4294-9600-4b74d1cd7d33 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:18.069232 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c077bc80-2a06-4294-9600-4b74d1cd7d33 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:18.069925 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c077bc80-2a06-4294-9600-4b74d1cd7d33 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:18.070378 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c077bc80-2a06-4294-9600-4b74d1cd7d33 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:18.070802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c077bc80-2a06-4294-9600-4b74d1cd7d33 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:18.205262 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-c077bc80-2a06-4294-9600-4b74d1cd7d33 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:18.212773 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-c077bc80-2a06-4294-9600-4b74d1cd7d33 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.155232 Aug 05 20:06:18.213339 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 186/361] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:18 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:19.233303 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-d2a145a3-5c3c-4840-9bbc-f776eec547af tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:19.234009 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-d2a145a3-5c3c-4840-9bbc-f776eec547af tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:19.240527 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d2a145a3-5c3c-4840-9bbc-f776eec547af tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:19.241048 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d2a145a3-5c3c-4840-9bbc-f776eec547af tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:19.241474 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d2a145a3-5c3c-4840-9bbc-f776eec547af tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:19.242158 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d2a145a3-5c3c-4840-9bbc-f776eec547af tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:19.242607 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d2a145a3-5c3c-4840-9bbc-f776eec547af tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:19.243044 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d2a145a3-5c3c-4840-9bbc-f776eec547af tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:19.371644 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-d2a145a3-5c3c-4840-9bbc-f776eec547af tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:19.379031 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-d2a145a3-5c3c-4840-9bbc-f776eec547af tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.149637 Aug 05 20:06:19.379601 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 176/362] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:19 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:20.399426 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-f249d578-0815-43bf-9f29-46a3293bee8f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:20.400703 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-f249d578-0815-43bf-9f29-46a3293bee8f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:20.407063 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f249d578-0815-43bf-9f29-46a3293bee8f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:20.407543 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f249d578-0815-43bf-9f29-46a3293bee8f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:20.407974 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f249d578-0815-43bf-9f29-46a3293bee8f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:20.408693 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f249d578-0815-43bf-9f29-46a3293bee8f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:20.409142 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f249d578-0815-43bf-9f29-46a3293bee8f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:20.409558 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f249d578-0815-43bf-9f29-46a3293bee8f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:20.541470 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-f249d578-0815-43bf-9f29-46a3293bee8f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:20.548913 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-f249d578-0815-43bf-9f29-46a3293bee8f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.153221 Aug 05 20:06:20.549471 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 187/363] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:20 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:21.572112 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f5b7f510-0fef-4103-ad78-361c653ee3c6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:21.572754 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f5b7f510-0fef-4103-ad78-361c653ee3c6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:21.579165 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f5b7f510-0fef-4103-ad78-361c653ee3c6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:21.579646 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f5b7f510-0fef-4103-ad78-361c653ee3c6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:21.580077 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f5b7f510-0fef-4103-ad78-361c653ee3c6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:21.580790 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f5b7f510-0fef-4103-ad78-361c653ee3c6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:21.581240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f5b7f510-0fef-4103-ad78-361c653ee3c6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:21.581661 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f5b7f510-0fef-4103-ad78-361c653ee3c6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:21.715651 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f5b7f510-0fef-4103-ad78-361c653ee3c6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:21.723129 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f5b7f510-0fef-4103-ad78-361c653ee3c6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.155402 Aug 05 20:06:21.723696 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 177/364] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:21 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:22.743921 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-0537d483-a35b-40ec-afaa-e79bd0500c1a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:22.744858 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-0537d483-a35b-40ec-afaa-e79bd0500c1a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:22.746953 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:22.752382 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0537d483-a35b-40ec-afaa-e79bd0500c1a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:22.752913 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0537d483-a35b-40ec-afaa-e79bd0500c1a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:22.753347 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0537d483-a35b-40ec-afaa-e79bd0500c1a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:22.754037 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0537d483-a35b-40ec-afaa-e79bd0500c1a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:22.754485 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0537d483-a35b-40ec-afaa-e79bd0500c1a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:22.754908 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0537d483-a35b-40ec-afaa-e79bd0500c1a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:22.888283 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-0537d483-a35b-40ec-afaa-e79bd0500c1a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:22.895858 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-0537d483-a35b-40ec-afaa-e79bd0500c1a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.155892 Aug 05 20:06:22.896426 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 188/365] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:22 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:23.917341 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e5f8e32f-e0de-422f-9547-8c499d33a005 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:23.918027 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e5f8e32f-e0de-422f-9547-8c499d33a005 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:23.920416 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:23.925746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e5f8e32f-e0de-422f-9547-8c499d33a005 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:23.926242 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e5f8e32f-e0de-422f-9547-8c499d33a005 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:23.926680 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e5f8e32f-e0de-422f-9547-8c499d33a005 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:23.927382 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e5f8e32f-e0de-422f-9547-8c499d33a005 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:23.927842 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e5f8e32f-e0de-422f-9547-8c499d33a005 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:23.928279 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e5f8e32f-e0de-422f-9547-8c499d33a005 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:23.932644 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=75 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:24.063907 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e5f8e32f-e0de-422f-9547-8c499d33a005 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:24.071231 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e5f8e32f-e0de-422f-9547-8c499d33a005 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.158265 Aug 05 20:06:24.072216 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 178/366] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:23 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:25.091963 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a6f7871d-718c-43e4-afc4-f159277b8b50 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:25.092663 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a6f7871d-718c-43e4-afc4-f159277b8b50 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:25.098509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a6f7871d-718c-43e4-afc4-f159277b8b50 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:25.098989 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a6f7871d-718c-43e4-afc4-f159277b8b50 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:25.099426 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a6f7871d-718c-43e4-afc4-f159277b8b50 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:25.100110 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a6f7871d-718c-43e4-afc4-f159277b8b50 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:25.100684 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a6f7871d-718c-43e4-afc4-f159277b8b50 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:25.100989 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a6f7871d-718c-43e4-afc4-f159277b8b50 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:25.105641 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=69 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:25.262840 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a6f7871d-718c-43e4-afc4-f159277b8b50 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:25.270862 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a6f7871d-718c-43e4-afc4-f159277b8b50 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.183516 Aug 05 20:06:25.271432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 189/367] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:25 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:26.292161 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-5db20323-f132-4252-8e1f-cb83785024a8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:26.292842 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-5db20323-f132-4252-8e1f-cb83785024a8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:26.299309 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5db20323-f132-4252-8e1f-cb83785024a8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:26.299793 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5db20323-f132-4252-8e1f-cb83785024a8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:26.300228 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5db20323-f132-4252-8e1f-cb83785024a8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:26.300944 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5db20323-f132-4252-8e1f-cb83785024a8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:26.301400 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5db20323-f132-4252-8e1f-cb83785024a8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:26.301824 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5db20323-f132-4252-8e1f-cb83785024a8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:26.468650 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-5db20323-f132-4252-8e1f-cb83785024a8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:26.476558 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-5db20323-f132-4252-8e1f-cb83785024a8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.189076 Aug 05 20:06:26.477528 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 179/368] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:26 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:27.498935 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-1774f736-4bb3-4bb2-a805-c8d35a3b8276 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:27.499585 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-1774f736-4bb3-4bb2-a805-c8d35a3b8276 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:27.506083 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1774f736-4bb3-4bb2-a805-c8d35a3b8276 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:27.506579 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1774f736-4bb3-4bb2-a805-c8d35a3b8276 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:27.507020 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1774f736-4bb3-4bb2-a805-c8d35a3b8276 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:27.507721 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1774f736-4bb3-4bb2-a805-c8d35a3b8276 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:27.508190 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1774f736-4bb3-4bb2-a805-c8d35a3b8276 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:27.508695 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1774f736-4bb3-4bb2-a805-c8d35a3b8276 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:27.663486 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-1774f736-4bb3-4bb2-a805-c8d35a3b8276 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:27.672708 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-1774f736-4bb3-4bb2-a805-c8d35a3b8276 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.177436 Aug 05 20:06:27.673724 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 190/369] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:27 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:28.460052 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-d6be7fe2-7a85-4c4f-b3ba-ba4772fe333a req-1d96cc03-8203-4f4b-906a-a7a6fc18b33d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1", "name": "network-vif-plugged", "status": "completed", "tag": "780a6046-5a34-4fe1-b8f7-b847e0fc78b0"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:06:28.498528 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-d6be7fe2-7a85-4c4f-b3ba-ba4772fe333a req-1d96cc03-8203-4f4b-906a-a7a6fc18b33d service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:28.499047 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-d6be7fe2-7a85-4c4f-b3ba-ba4772fe333a req-1d96cc03-8203-4f4b-906a-a7a6fc18b33d service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:28.499538 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-d6be7fe2-7a85-4c4f-b3ba-ba4772fe333a req-1d96cc03-8203-4f4b-906a-a7a6fc18b33d service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:28.513470 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-d6be7fe2-7a85-4c4f-b3ba-ba4772fe333a req-1d96cc03-8203-4f4b-906a-a7a6fc18b33d service nova] Creating event network-vif-plugged:780a6046-5a34-4fe1-b8f7-b847e0fc78b0 for instance 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 on hv-cinder-85221 Aug 05 20:06:28.520493 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-d6be7fe2-7a85-4c4f-b3ba-ba4772fe333a req-1d96cc03-8203-4f4b-906a-a7a6fc18b33d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063849 Aug 05 20:06:28.521365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 180/370] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:06:28.695528 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4f844086-0590-4fbc-892a-a2a80178c71e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:28.696149 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-4f844086-0590-4fbc-892a-a2a80178c71e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:28.704069 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4f844086-0590-4fbc-892a-a2a80178c71e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:28.705211 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4f844086-0590-4fbc-892a-a2a80178c71e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:28.705854 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4f844086-0590-4fbc-892a-a2a80178c71e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:28.707754 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4f844086-0590-4fbc-892a-a2a80178c71e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:28.708514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4f844086-0590-4fbc-892a-a2a80178c71e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:28.708967 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4f844086-0590-4fbc-892a-a2a80178c71e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:28.868470 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-4f844086-0590-4fbc-892a-a2a80178c71e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:28.879533 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-4f844086-0590-4fbc-892a-a2a80178c71e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.189136 Aug 05 20:06:28.880307 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 191/371] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:28 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:29.901883 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-44e0e65f-5d38-409a-ac08-7dac6e249588 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:29.902578 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-44e0e65f-5d38-409a-ac08-7dac6e249588 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:29.909194 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-44e0e65f-5d38-409a-ac08-7dac6e249588 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:29.909679 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-44e0e65f-5d38-409a-ac08-7dac6e249588 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:29.910118 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-44e0e65f-5d38-409a-ac08-7dac6e249588 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:29.910807 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-44e0e65f-5d38-409a-ac08-7dac6e249588 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:29.911263 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-44e0e65f-5d38-409a-ac08-7dac6e249588 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:29.911689 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-44e0e65f-5d38-409a-ac08-7dac6e249588 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:30.045363 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-44e0e65f-5d38-409a-ac08-7dac6e249588 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:30.052665 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-44e0e65f-5d38-409a-ac08-7dac6e249588 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.155087 Aug 05 20:06:30.053223 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 181/372] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:29 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:31.073237 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-34b80832-e25a-4df6-a568-a357eedf05d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:31.073846 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-34b80832-e25a-4df6-a568-a357eedf05d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:31.080084 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-34b80832-e25a-4df6-a568-a357eedf05d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:31.080568 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-34b80832-e25a-4df6-a568-a357eedf05d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:31.081026 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-34b80832-e25a-4df6-a568-a357eedf05d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:31.081709 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-34b80832-e25a-4df6-a568-a357eedf05d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:31.082178 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-34b80832-e25a-4df6-a568-a357eedf05d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:31.082586 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-34b80832-e25a-4df6-a568-a357eedf05d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:31.218141 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-34b80832-e25a-4df6-a568-a357eedf05d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:31.225517 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-34b80832-e25a-4df6-a568-a357eedf05d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.156253 Aug 05 20:06:31.226075 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 192/373] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:31 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:32.247118 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-0e552176-c4c5-4d79-941e-b27e1fe44b3e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:32.247745 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-0e552176-c4c5-4d79-941e-b27e1fe44b3e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:32.254158 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0e552176-c4c5-4d79-941e-b27e1fe44b3e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:32.254641 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0e552176-c4c5-4d79-941e-b27e1fe44b3e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:32.255078 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0e552176-c4c5-4d79-941e-b27e1fe44b3e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:32.255774 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0e552176-c4c5-4d79-941e-b27e1fe44b3e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:32.256261 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0e552176-c4c5-4d79-941e-b27e1fe44b3e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:32.256789 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0e552176-c4c5-4d79-941e-b27e1fe44b3e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:32.385792 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-0e552176-c4c5-4d79-941e-b27e1fe44b3e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:32.394755 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-0e552176-c4c5-4d79-941e-b27e1fe44b3e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.152116 Aug 05 20:06:32.395327 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 182/374] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:32 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:33.415232 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-48003921-51b2-46a5-bd8c-679f7c9ae1a1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:33.416416 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-48003921-51b2-46a5-bd8c-679f7c9ae1a1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:33.422738 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-48003921-51b2-46a5-bd8c-679f7c9ae1a1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:33.423220 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-48003921-51b2-46a5-bd8c-679f7c9ae1a1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:33.423664 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-48003921-51b2-46a5-bd8c-679f7c9ae1a1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:33.424346 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-48003921-51b2-46a5-bd8c-679f7c9ae1a1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:33.424823 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-48003921-51b2-46a5-bd8c-679f7c9ae1a1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:33.425248 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-48003921-51b2-46a5-bd8c-679f7c9ae1a1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:33.552105 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-48003921-51b2-46a5-bd8c-679f7c9ae1a1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:33.559690 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-48003921-51b2-46a5-bd8c-679f7c9ae1a1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.148372 Aug 05 20:06:33.560253 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 193/375] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:33 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:34.580121 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-c7bf2cad-0b9a-4670-9e1c-c4551d9bf1ed tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:34.580764 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-c7bf2cad-0b9a-4670-9e1c-c4551d9bf1ed tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:34.587108 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c7bf2cad-0b9a-4670-9e1c-c4551d9bf1ed tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:34.588097 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c7bf2cad-0b9a-4670-9e1c-c4551d9bf1ed tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:34.588541 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c7bf2cad-0b9a-4670-9e1c-c4551d9bf1ed tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:34.589262 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c7bf2cad-0b9a-4670-9e1c-c4551d9bf1ed tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:34.589726 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c7bf2cad-0b9a-4670-9e1c-c4551d9bf1ed tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:34.590156 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c7bf2cad-0b9a-4670-9e1c-c4551d9bf1ed tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:34.727140 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-c7bf2cad-0b9a-4670-9e1c-c4551d9bf1ed tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:34.735623 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-c7bf2cad-0b9a-4670-9e1c-c4551d9bf1ed tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.159239 Aug 05 20:06:34.736242 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 183/376] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:34 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:35.757042 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-992ae0d4-2ec4-40e1-a120-5e9033117c30 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:35.757581 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-992ae0d4-2ec4-40e1-a120-5e9033117c30 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:35.764924 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-992ae0d4-2ec4-40e1-a120-5e9033117c30 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:35.765411 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-992ae0d4-2ec4-40e1-a120-5e9033117c30 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:35.765854 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-992ae0d4-2ec4-40e1-a120-5e9033117c30 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:35.766798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-992ae0d4-2ec4-40e1-a120-5e9033117c30 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:35.767251 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-992ae0d4-2ec4-40e1-a120-5e9033117c30 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:35.767678 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-992ae0d4-2ec4-40e1-a120-5e9033117c30 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:35.898498 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-992ae0d4-2ec4-40e1-a120-5e9033117c30 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:35.906482 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-992ae0d4-2ec4-40e1-a120-5e9033117c30 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.153367 Aug 05 20:06:35.907046 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 194/377] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:35 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:36.927511 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-768cf069-1c15-48f8-b77a-bb907537759a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:36.928221 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-768cf069-1c15-48f8-b77a-bb907537759a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:36.935025 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-768cf069-1c15-48f8-b77a-bb907537759a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:36.935518 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-768cf069-1c15-48f8-b77a-bb907537759a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:36.935956 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-768cf069-1c15-48f8-b77a-bb907537759a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:36.936679 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-768cf069-1c15-48f8-b77a-bb907537759a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:36.937134 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-768cf069-1c15-48f8-b77a-bb907537759a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:36.937559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-768cf069-1c15-48f8-b77a-bb907537759a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:37.072269 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-768cf069-1c15-48f8-b77a-bb907537759a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:37.079598 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-768cf069-1c15-48f8-b77a-bb907537759a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1371 microversion: 2.1 time: 0.156002 Aug 05 20:06:37.080192 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 184/378] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:36 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:37.531252 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-2554b9b4-520f-4bd5-80ce-42ec5167b233 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:37.531749 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-2554b9b4-520f-4bd5-80ce-42ec5167b233 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:37.538024 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2554b9b4-520f-4bd5-80ce-42ec5167b233 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:37.538523 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2554b9b4-520f-4bd5-80ce-42ec5167b233 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:37.538964 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2554b9b4-520f-4bd5-80ce-42ec5167b233 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:37.539663 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2554b9b4-520f-4bd5-80ce-42ec5167b233 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:37.540121 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2554b9b4-520f-4bd5-80ce-42ec5167b233 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:37.540547 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2554b9b4-520f-4bd5-80ce-42ec5167b233 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:37.679585 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.objects.instance [None req-2554b9b4-520f-4bd5-80ce-42ec5167b233 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lazy-loading 'services' on Instance uuid bf08b0d1-20cc-4376-a64e-ea887189202b {{(pid=118192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:06:37.800598 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-2554b9b4-520f-4bd5-80ce-42ec5167b233 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b/os-volume_attachments/4b459dbd-3395-4b85-be78-22c67981c565" status: 202 len: 0 microversion: 2.1 time: 0.273022 Aug 05 20:06:37.801305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 195/379] 10.222.0.39 () {58 vars in 1416 bytes} [Fri Aug 5 20:06:37 2022] DELETE /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b/os-volume_attachments/4b459dbd-3395-4b85-be78-22c67981c565 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:06:38.100867 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-12332aec-cca2-4a94-a900-086193f0a84f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:38.101484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-12332aec-cca2-4a94-a900-086193f0a84f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:38.108612 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-12332aec-cca2-4a94-a900-086193f0a84f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:38.109104 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-12332aec-cca2-4a94-a900-086193f0a84f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:38.109545 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-12332aec-cca2-4a94-a900-086193f0a84f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:38.110240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-12332aec-cca2-4a94-a900-086193f0a84f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:38.110699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-12332aec-cca2-4a94-a900-086193f0a84f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:38.111163 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-12332aec-cca2-4a94-a900-086193f0a84f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:38.242997 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-12332aec-cca2-4a94-a900-086193f0a84f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:38.251556 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-12332aec-cca2-4a94-a900-086193f0a84f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1566 microversion: 2.1 time: 0.154629 Aug 05 20:06:38.252121 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 185/380] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:38 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:38.273737 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-fedc87c9-f32d-4384-918b-7bd4acb96a68 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:38.274311 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-fedc87c9-f32d-4384-918b-7bd4acb96a68 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:38.280670 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fedc87c9-f32d-4384-918b-7bd4acb96a68 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:38.281149 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fedc87c9-f32d-4384-918b-7bd4acb96a68 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:38.281581 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fedc87c9-f32d-4384-918b-7bd4acb96a68 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:38.282264 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fedc87c9-f32d-4384-918b-7bd4acb96a68 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:38.282712 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fedc87c9-f32d-4384-918b-7bd4acb96a68 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:38.283129 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fedc87c9-f32d-4384-918b-7bd4acb96a68 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:38.360726 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-fedc87c9-f32d-4384-918b-7bd4acb96a68 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091181 Aug 05 20:06:38.361317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 196/381] 10.222.0.39 () {58 vars in 1275 bytes} [Fri Aug 5 20:06:38 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:06:39.498285 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-c44b90d1-f154-4fdb-819a-de891a0216e0 req-f6428739-24c5-454a-bf81-8d3a1332b30e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1", "tag": "780a6046-5a34-4fe1-b8f7-b847e0fc78b0"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:06:39.508278 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-c44b90d1-f154-4fdb-819a-de891a0216e0 req-f6428739-24c5-454a-bf81-8d3a1332b30e service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:39.508785 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-c44b90d1-f154-4fdb-819a-de891a0216e0 req-f6428739-24c5-454a-bf81-8d3a1332b30e service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:39.509214 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-c44b90d1-f154-4fdb-819a-de891a0216e0 req-f6428739-24c5-454a-bf81-8d3a1332b30e service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:39.521669 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-c44b90d1-f154-4fdb-819a-de891a0216e0 req-f6428739-24c5-454a-bf81-8d3a1332b30e service nova] Creating event network-changed:780a6046-5a34-4fe1-b8f7-b847e0fc78b0 for instance 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 on hv-cinder-85221 Aug 05 20:06:39.526717 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-c44b90d1-f154-4fdb-819a-de891a0216e0 req-f6428739-24c5-454a-bf81-8d3a1332b30e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032733 Aug 05 20:06:39.528027 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 186/382] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:06:40.010004 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-86c5d69a-f4a1-49b0-a566-7c8d770e6788 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:40.010565 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-86c5d69a-f4a1-49b0-a566-7c8d770e6788 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:40.018045 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-86c5d69a-f4a1-49b0-a566-7c8d770e6788 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:40.018919 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-86c5d69a-f4a1-49b0-a566-7c8d770e6788 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:40.019686 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-86c5d69a-f4a1-49b0-a566-7c8d770e6788 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:40.020563 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-86c5d69a-f4a1-49b0-a566-7c8d770e6788 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:40.021199 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-86c5d69a-f4a1-49b0-a566-7c8d770e6788 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:40.021785 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-86c5d69a-f4a1-49b0-a566-7c8d770e6788 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:40.061523 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-86c5d69a-f4a1-49b0-a566-7c8d770e6788 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Going to try to terminate instance {{(pid=118192) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:06:40.205096 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-86c5d69a-f4a1-49b0-a566-7c8d770e6788 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 204 len: 0 microversion: 2.1 time: 0.198967 Aug 05 20:06:40.205950 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 197/383] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:06:40 2022] DELETE /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:06:40.215657 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-6d1f0556-9487-43e7-80cb-0ae4068b18a0 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:40.217144 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-6d1f0556-9487-43e7-80cb-0ae4068b18a0 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:40.225338 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6d1f0556-9487-43e7-80cb-0ae4068b18a0 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:40.225835 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6d1f0556-9487-43e7-80cb-0ae4068b18a0 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:40.226525 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6d1f0556-9487-43e7-80cb-0ae4068b18a0 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:40.227452 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6d1f0556-9487-43e7-80cb-0ae4068b18a0 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:40.227911 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6d1f0556-9487-43e7-80cb-0ae4068b18a0 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:40.228378 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6d1f0556-9487-43e7-80cb-0ae4068b18a0 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:40.372891 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-6d1f0556-9487-43e7-80cb-0ae4068b18a0 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:40.382976 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-6d1f0556-9487-43e7-80cb-0ae4068b18a0 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1512 microversion: 2.1 time: 0.172366 Aug 05 20:06:40.384679 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 187/384] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:40 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:41.406533 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-93691dfa-6495-4e3b-b483-105faa8a6331 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:41.407328 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-93691dfa-6495-4e3b-b483-105faa8a6331 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:41.414544 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-93691dfa-6495-4e3b-b483-105faa8a6331 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:41.415164 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-93691dfa-6495-4e3b-b483-105faa8a6331 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:41.415692 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-93691dfa-6495-4e3b-b483-105faa8a6331 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:41.416456 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-93691dfa-6495-4e3b-b483-105faa8a6331 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:41.417673 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-93691dfa-6495-4e3b-b483-105faa8a6331 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:41.418662 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-93691dfa-6495-4e3b-b483-105faa8a6331 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:41.561548 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-93691dfa-6495-4e3b-b483-105faa8a6331 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:41.570261 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-93691dfa-6495-4e3b-b483-105faa8a6331 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1512 microversion: 2.1 time: 0.168498 Aug 05 20:06:41.570834 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 198/385] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:41 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:42.595424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-710c64db-efee-4e4b-9b71-83807f40d7c2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:42.596042 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-710c64db-efee-4e4b-9b71-83807f40d7c2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:42.602494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-710c64db-efee-4e4b-9b71-83807f40d7c2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:42.602983 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-710c64db-efee-4e4b-9b71-83807f40d7c2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:42.603424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-710c64db-efee-4e4b-9b71-83807f40d7c2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:42.604119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-710c64db-efee-4e4b-9b71-83807f40d7c2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:42.605185 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-710c64db-efee-4e4b-9b71-83807f40d7c2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:42.605622 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-710c64db-efee-4e4b-9b71-83807f40d7c2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:42.743494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-710c64db-efee-4e4b-9b71-83807f40d7c2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:42.751367 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-710c64db-efee-4e4b-9b71-83807f40d7c2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1512 microversion: 2.1 time: 0.159731 Aug 05 20:06:42.751975 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 188/386] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:42 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:06:43.774618 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-41d7e055-da96-4b63-b3bb-10eddb2531f5 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:43.775361 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-41d7e055-da96-4b63-b3bb-10eddb2531f5 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:43.781914 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-41d7e055-da96-4b63-b3bb-10eddb2531f5 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:43.782488 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-41d7e055-da96-4b63-b3bb-10eddb2531f5 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:43.782922 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-41d7e055-da96-4b63-b3bb-10eddb2531f5 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:43.783620 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-41d7e055-da96-4b63-b3bb-10eddb2531f5 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:43.784100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-41d7e055-da96-4b63-b3bb-10eddb2531f5 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:43.784593 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-41d7e055-da96-4b63-b3bb-10eddb2531f5 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:43.928548 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-41d7e055-da96-4b63-b3bb-10eddb2531f5 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:43.936376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-41d7e055-da96-4b63-b3bb-10eddb2531f5 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1512 microversion: 2.1 time: 0.165625 Aug 05 20:06:43.937380 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 199/387] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:43 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:44.958121 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-ca02c0ba-9e8d-445b-a960-76768ee6af92 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:44.958737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-ca02c0ba-9e8d-445b-a960-76768ee6af92 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:44.965557 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ca02c0ba-9e8d-445b-a960-76768ee6af92 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:44.966255 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ca02c0ba-9e8d-445b-a960-76768ee6af92 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:44.966693 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ca02c0ba-9e8d-445b-a960-76768ee6af92 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:44.967428 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ca02c0ba-9e8d-445b-a960-76768ee6af92 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:44.967889 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ca02c0ba-9e8d-445b-a960-76768ee6af92 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:44.968317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ca02c0ba-9e8d-445b-a960-76768ee6af92 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:45.107955 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-ca02c0ba-9e8d-445b-a960-76768ee6af92 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:45.116561 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-ca02c0ba-9e8d-445b-a960-76768ee6af92 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1512 microversion: 2.1 time: 0.162854 Aug 05 20:06:45.120807 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 189/388] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:44 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:46.141013 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-7e5449a7-4b13-49b7-8c28-1e428b007509 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:46.142355 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-7e5449a7-4b13-49b7-8c28-1e428b007509 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:46.149446 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7e5449a7-4b13-49b7-8c28-1e428b007509 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:46.149940 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7e5449a7-4b13-49b7-8c28-1e428b007509 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:46.150542 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7e5449a7-4b13-49b7-8c28-1e428b007509 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:46.151364 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7e5449a7-4b13-49b7-8c28-1e428b007509 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:46.152325 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7e5449a7-4b13-49b7-8c28-1e428b007509 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:46.153754 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7e5449a7-4b13-49b7-8c28-1e428b007509 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:46.301058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-7e5449a7-4b13-49b7-8c28-1e428b007509 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:46.310093 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-7e5449a7-4b13-49b7-8c28-1e428b007509 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1512 microversion: 2.1 time: 0.172970 Aug 05 20:06:46.310759 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 200/389] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:46 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:47.331410 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-d817c637-c90b-47f1-9213-8ff775752a35 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:47.332026 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-d817c637-c90b-47f1-9213-8ff775752a35 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:47.338419 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d817c637-c90b-47f1-9213-8ff775752a35 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:47.338941 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d817c637-c90b-47f1-9213-8ff775752a35 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:47.339383 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d817c637-c90b-47f1-9213-8ff775752a35 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:47.340420 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d817c637-c90b-47f1-9213-8ff775752a35 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:47.340913 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d817c637-c90b-47f1-9213-8ff775752a35 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:47.341348 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d817c637-c90b-47f1-9213-8ff775752a35 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:47.717209 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-d817c637-c90b-47f1-9213-8ff775752a35 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:47.736986 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-d817c637-c90b-47f1-9213-8ff775752a35 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1512 microversion: 2.1 time: 0.409394 Aug 05 20:06:47.737520 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 190/390] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:47 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1512 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:48.440966 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-af0076aa-14ad-443a-bb38-4566bc40cf06 req-113fa31c-e8a5-4feb-9a28-dece75447f75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf08b0d1-20cc-4376-a64e-ea887189202b", "name": "network-vif-deleted", "tag": "215127cb-94a3-4b9b-a81a-bfba8a203583"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:06:48.452822 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-af0076aa-14ad-443a-bb38-4566bc40cf06 req-113fa31c-e8a5-4feb-9a28-dece75447f75 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:48.453593 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-af0076aa-14ad-443a-bb38-4566bc40cf06 req-113fa31c-e8a5-4feb-9a28-dece75447f75 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:48.454032 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-af0076aa-14ad-443a-bb38-4566bc40cf06 req-113fa31c-e8a5-4feb-9a28-dece75447f75 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:48.466623 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-af0076aa-14ad-443a-bb38-4566bc40cf06 req-113fa31c-e8a5-4feb-9a28-dece75447f75 service nova] Creating event network-vif-deleted:215127cb-94a3-4b9b-a81a-bfba8a203583 for instance bf08b0d1-20cc-4376-a64e-ea887189202b on hv-cinder-85221 Aug 05 20:06:48.472633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-af0076aa-14ad-443a-bb38-4566bc40cf06 req-113fa31c-e8a5-4feb-9a28-dece75447f75 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035218 Aug 05 20:06:48.473515 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 201/391] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:06:48.758817 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-0fc40baf-a3f5-45e5-bed2-509e3d068c3d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:48.759466 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-0fc40baf-a3f5-45e5-bed2-509e3d068c3d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:48.767236 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0fc40baf-a3f5-45e5-bed2-509e3d068c3d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:48.767723 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0fc40baf-a3f5-45e5-bed2-509e3d068c3d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:48.768155 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0fc40baf-a3f5-45e5-bed2-509e3d068c3d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:48.768879 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0fc40baf-a3f5-45e5-bed2-509e3d068c3d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:48.769326 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0fc40baf-a3f5-45e5-bed2-509e3d068c3d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:48.769750 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0fc40baf-a3f5-45e5-bed2-509e3d068c3d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:48.802984 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0fc40baf-a3f5-45e5-bed2-509e3d068c3d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:48.803474 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0fc40baf-a3f5-45e5-bed2-509e3d068c3d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:48.803908 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0fc40baf-a3f5-45e5-bed2-509e3d068c3d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:48.804363 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.objects.instance [None req-0fc40baf-a3f5-45e5-bed2-509e3d068c3d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lazy-loading 'fault' on Instance uuid bf08b0d1-20cc-4376-a64e-ea887189202b {{(pid=118191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:06:48.893767 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-0fc40baf-a3f5-45e5-bed2-509e3d068c3d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:48.902136 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-0fc40baf-a3f5-45e5-bed2-509e3d068c3d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 200 len: 1309 microversion: 2.1 time: 0.147199 Aug 05 20:06:48.914396 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 191/392] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:48 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 1309 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:06:49.925388 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-7e7e91e8-ff2a-4338-b7ee-eda75846cb21 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:49.926089 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-7e7e91e8-ff2a-4338-b7ee-eda75846cb21 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: bf08b0d1-20cc-4376-a64e-ea887189202b] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:49.932626 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7e7e91e8-ff2a-4338-b7ee-eda75846cb21 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:49.933117 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7e7e91e8-ff2a-4338-b7ee-eda75846cb21 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:49.933584 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7e7e91e8-ff2a-4338-b7ee-eda75846cb21 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:49.934271 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7e7e91e8-ff2a-4338-b7ee-eda75846cb21 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:49.934722 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7e7e91e8-ff2a-4338-b7ee-eda75846cb21 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:49.935146 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7e7e91e8-ff2a-4338-b7ee-eda75846cb21 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:49.947887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-7e7e91e8-ff2a-4338-b7ee-eda75846cb21 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] HTTP exception thrown: Instance bf08b0d1-20cc-4376-a64e-ea887189202b could not be found. Aug 05 20:06:49.949536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-7e7e91e8-ff2a-4338-b7ee-eda75846cb21 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Request method failure captured: Aug 05 20:06:49.949536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b HTTP/1.1 Aug 05 20:06:49.949536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:06:49.949536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:06:49.949536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:06:49.949536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 0 Aug 05 20:06:49.949536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:06:49.949536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:06:49.949536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:06:49.949536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:06:49.949536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XefZUTxiNutf-ql3Lkh3LilSNEfs_JJCt-aCeGY0Fk72I6eBkGr2KMboWBp_Nnv6TkATU78prPNjPnL_AbO2pBJRu6xsTlm4TzC18_4Qk_7rglHfbu5RBZ7SiyxKXUGM6FVs9OO175EDFCz2i_qZiIamaXZgvjLresOZcFILS_iOJQ Aug 05 20:06:49.949536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:06:49.949536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:06:49.949536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:06:49.949536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:06:49.949536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:06:49.949536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:06:49.949536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: 7a5caf50650e45fbb1872e277f56e3b3 Aug 05 20:06:49.949536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-VolumesSnapshotTestJSON-630007995 Aug 05 20:06:49.949536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:06:49.949536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:06:49.951095 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7a5caf50650e45fbb1872e277f56e3b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a5caf50650e45fbb1872e277f56e3b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a5caf50650e45fbb1872e277f56e3b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7a5caf50650e45fbb1872e277f56e3b3", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:06:49.951095 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-VolumesSnapshotTestJSON-630007995 Aug 05 20:06:49.951095 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: 7a5caf50650e45fbb1872e277f56e3b3 Aug 05 20:06:49.951095 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-630007995 Aug 05 20:06:49.951095 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-VolumesSnapshotTestJSON-630007995-project Aug 05 20:06:49.951095 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:06:49.951095 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:06:49.951095 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: ac0a233c84e1413490057c64654abe99 Aug 05 20:06:49.951095 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-VolumesSnapshotTestJSON-630007995-project Aug 05 20:06:49.951095 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: > Aug 05 20:06:49.951095 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Instance bf08b0d1-20cc-4376-a64e-ea887189202b could not be found. Aug 05 20:06:49.951095 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'id': 'bf08b0d1-20cc-4376-a64e-ea887189202b'} Aug 05 20:06:49.951997 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:06:49.951997 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:06:49.951997 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:06:49.951997 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:06:49.951997 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:06:49.951997 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:06:49.951997 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:06:49.951997 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:06:49.951997 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:06:49.951997 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:06:49.951997 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf08b0d1-20cc-4376-a64e-ea887189202b could not be found. Aug 05 20:06:49.951997 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:06:49.951997 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:06:49.951997 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:06:49.951997 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:06:49.951997 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:06:49.951997 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:06:49.951997 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:06:49.951997 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:06:49.951997 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:06:49.953578 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:06:49.953578 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:06:49.953578 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:06:49.953578 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:06:49.953578 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:06:49.953578 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:06:49.953578 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:06:49.953578 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf08b0d1-20cc-4376-a64e-ea887189202b could not be found. Aug 05 20:06:49.953578 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:06:49.953578 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:06:49.953578 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:06:49.953578 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:06:49.953578 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:06:49.953578 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:06:49.953578 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:06:49.953578 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:06:49.953578 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf08b0d1-20cc-4376-a64e-ea887189202b could not be found. Aug 05 20:06:49.953578 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:06:49.954839 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-7e7e91e8-ff2a-4338-b7ee-eda75846cb21 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Returning 404 to user: Instance bf08b0d1-20cc-4376-a64e-ea887189202b could not be found. {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:06:49.954839 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-7e7e91e8-ff2a-4338-b7ee-eda75846cb21 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b" status: 404 len: 111 microversion: 2.1 time: 0.029774 Aug 05 20:06:49.954839 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 202/393] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:49 2022] GET /compute/v2.1/servers/bf08b0d1-20cc-4376-a64e-ea887189202b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:06:59.308688 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-8b21d0b2-3ba3-4feb-8310-58dbc0a33bb9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1002241861", "imageRef": "c148255e-9574-4d10-b9bb-13c9411eda77", "flavorRef": "452", "networks": [{"uuid": "932aef3c-9338-45de-939c-0a4c2ca3bb73"}]}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:06:59.317366 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=29 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:59.318006 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=77 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:59.363637 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.network.neutron [None req-8b21d0b2-3ba3-4feb-8310-58dbc0a33bb9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] validate_networks() for [('932aef3c-9338-45de-939c-0a4c2ca3bb73', None, None, None, None, None)] {{(pid=118191) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:06:59.735918 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-8b21d0b2-3ba3-4feb-8310-58dbc0a33bb9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Flavor limits 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:06:59.736341 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-8b21d0b2-3ba3-4feb-8310-58dbc0a33bb9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Image limits 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:06:59.736846 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-8b21d0b2-3ba3-4feb-8310-58dbc0a33bb9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Flavor pref 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:06:59.737284 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-8b21d0b2-3ba3-4feb-8310-58dbc0a33bb9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Image pref 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:06:59.737700 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-8b21d0b2-3ba3-4feb-8310-58dbc0a33bb9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:06:59.747000 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8b21d0b2-3ba3-4feb-8310-58dbc0a33bb9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:59.747593 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8b21d0b2-3ba3-4feb-8310-58dbc0a33bb9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:59.747920 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8b21d0b2-3ba3-4feb-8310-58dbc0a33bb9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:59.748675 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8b21d0b2-3ba3-4feb-8310-58dbc0a33bb9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:06:59.749131 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8b21d0b2-3ba3-4feb-8310-58dbc0a33bb9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:06:59.749552 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8b21d0b2-3ba3-4feb-8310-58dbc0a33bb9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:06:59.767232 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-8b21d0b2-3ba3-4feb-8310-58dbc0a33bb9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Getting quotas for project 2fee7422708346709cc0524d685031b3. Resources: {'cores', 'ram', 'instances'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:06:59.771339 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-8b21d0b2-3ba3-4feb-8310-58dbc0a33bb9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Getting quotas for user a0dbaac800624b85ab8c07a369cf0aff and project 2fee7422708346709cc0524d685031b3. Resources: {'cores', 'ram', 'instances'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:06:59.782679 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-8b21d0b2-3ba3-4feb-8310-58dbc0a33bb9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Going to run 1 instances... {{(pid=118191) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:06:59.785107 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-8b21d0b2-3ba3-4feb-8310-58dbc0a33bb9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c148255e-9574-4d10-b9bb-13c9411eda77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118191) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:06:59.830751 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-8b21d0b2-3ba3-4feb-8310-58dbc0a33bb9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525642 Aug 05 20:06:59.838381 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 192/394] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Aug 5 20:06:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:06:59.844812 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-be987453-7841-449b-8372-680e467927b7 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:06:59.845504 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-be987453-7841-449b-8372-680e467927b7 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:06:59.847647 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:06:59.908246 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-be987453-7841-449b-8372-680e467927b7 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:06:59.916935 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-be987453-7841-449b-8372-680e467927b7 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1214 microversion: 2.1 time: 0.077111 Aug 05 20:06:59.926800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 203/395] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:06:59 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:00.150358 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-25cb1dc6-7230-413b-b9c5-f88f00ea3e6a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-955934896", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1038104014", "security_groups": [{"name": "tempest-secgroup-smoke-19031576"}], "networks": [{"uuid": "2cbe21a1-108b-48fe-a99d-5817978c0436"}], "block_device_mapping_v2": [{"uuid": "692faaee-36fc-40dd-a8be-f7300d99c950", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:00.321463 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.network.neutron [None req-25cb1dc6-7230-413b-b9c5-f88f00ea3e6a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] validate_networks() for [('2cbe21a1-108b-48fe-a99d-5817978c0436', None, None, None, None, None)] {{(pid=118191) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:07:00.714724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-25cb1dc6-7230-413b-b9c5-f88f00ea3e6a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Flavor limits 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:07:00.715209 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-25cb1dc6-7230-413b-b9c5-f88f00ea3e6a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Image limits 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:07:00.715704 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-25cb1dc6-7230-413b-b9c5-f88f00ea3e6a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Flavor pref 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:07:00.716234 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-25cb1dc6-7230-413b-b9c5-f88f00ea3e6a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Image pref 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:07:00.716685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-25cb1dc6-7230-413b-b9c5-f88f00ea3e6a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:07:00.725364 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-25cb1dc6-7230-413b-b9c5-f88f00ea3e6a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:00.725855 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-25cb1dc6-7230-413b-b9c5-f88f00ea3e6a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:00.726290 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-25cb1dc6-7230-413b-b9c5-f88f00ea3e6a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:00.727204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-25cb1dc6-7230-413b-b9c5-f88f00ea3e6a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:00.727668 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-25cb1dc6-7230-413b-b9c5-f88f00ea3e6a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:00.728101 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-25cb1dc6-7230-413b-b9c5-f88f00ea3e6a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:00.745499 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-25cb1dc6-7230-413b-b9c5-f88f00ea3e6a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Getting quotas for project 3f8a529448f14ef18a72de884f17d0f6. Resources: {'cores', 'ram', 'instances'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:07:00.749982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-25cb1dc6-7230-413b-b9c5-f88f00ea3e6a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Getting quotas for user 0e022456457d41b8812058252e4a43f4 and project 3f8a529448f14ef18a72de884f17d0f6. Resources: {'cores', 'ram', 'instances'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:07:00.813935 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-25cb1dc6-7230-413b-b9c5-f88f00ea3e6a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Going to run 1 instances... {{(pid=118191) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:07:00.816020 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-25cb1dc6-7230-413b-b9c5-f88f00ea3e6a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='692faaee-36fc-40dd-a8be-f7300d99c950',volume_size=None,volume_type=None)] {{(pid=118191) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:07:00.939481 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-56b0d05b-162e-4638-96dd-ff668a23ce8b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:00.941024 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-56b0d05b-162e-4638-96dd-ff668a23ce8b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:00.943179 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:00.945874 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-25cb1dc6-7230-413b-b9c5-f88f00ea3e6a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.799764 Aug 05 20:07:00.946357 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 193/396] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Aug 5 20:07:00 2022] POST /compute/v2.1/servers => generated 404 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:07:00.951280 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-56b0d05b-162e-4638-96dd-ff668a23ce8b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:00.951967 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-56b0d05b-162e-4638-96dd-ff668a23ce8b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:00.952681 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-56b0d05b-162e-4638-96dd-ff668a23ce8b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:00.953545 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-56b0d05b-162e-4638-96dd-ff668a23ce8b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:00.954155 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-56b0d05b-162e-4638-96dd-ff668a23ce8b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:00.954750 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-56b0d05b-162e-4638-96dd-ff668a23ce8b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:00.956726 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a674da83-1e0a-4718-9ca3-e12386d8e040 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:00.957339 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-a674da83-1e0a-4718-9ca3-e12386d8e040 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:01.029295 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a674da83-1e0a-4718-9ca3-e12386d8e040 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:01.036932 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-a674da83-1e0a-4718-9ca3-e12386d8e040 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1088 microversion: 2.1 time: 0.083847 Aug 05 20:07:01.048624 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 194/397] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:00 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1088 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:01.051568 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-56b0d05b-162e-4638-96dd-ff668a23ce8b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:01.060180 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-56b0d05b-162e-4638-96dd-ff668a23ce8b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1266 microversion: 2.1 time: 0.123721 Aug 05 20:07:01.060647 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 204/398] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:00 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1266 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:02.058310 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-153f9266-8f05-4783-8fe0-3ee1bb69acaf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:02.058908 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-153f9266-8f05-4783-8fe0-3ee1bb69acaf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:02.065622 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-153f9266-8f05-4783-8fe0-3ee1bb69acaf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:02.066120 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-153f9266-8f05-4783-8fe0-3ee1bb69acaf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:02.066624 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-153f9266-8f05-4783-8fe0-3ee1bb69acaf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:02.067324 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-153f9266-8f05-4783-8fe0-3ee1bb69acaf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:02.067775 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-153f9266-8f05-4783-8fe0-3ee1bb69acaf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:02.068201 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-153f9266-8f05-4783-8fe0-3ee1bb69acaf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:02.083030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-02289e93-8f07-4379-83f9-a32b01dde06c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:02.083751 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-02289e93-8f07-4379-83f9-a32b01dde06c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:02.090991 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-02289e93-8f07-4379-83f9-a32b01dde06c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:02.091525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-02289e93-8f07-4379-83f9-a32b01dde06c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:02.091929 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-02289e93-8f07-4379-83f9-a32b01dde06c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:02.092670 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-02289e93-8f07-4379-83f9-a32b01dde06c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:02.093440 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-02289e93-8f07-4379-83f9-a32b01dde06c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:02.093873 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-02289e93-8f07-4379-83f9-a32b01dde06c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:02.152002 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-153f9266-8f05-4783-8fe0-3ee1bb69acaf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:02.159988 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-153f9266-8f05-4783-8fe0-3ee1bb69acaf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1186 microversion: 2.1 time: 0.105591 Aug 05 20:07:02.160674 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 195/399] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:02 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1186 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:02.242494 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-02289e93-8f07-4379-83f9-a32b01dde06c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:02.251229 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-02289e93-8f07-4379-83f9-a32b01dde06c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1314 microversion: 2.1 time: 0.172197 Aug 05 20:07:02.251799 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 205/400] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:02 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:02.598153 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-f76fc14e-cc00-48ce-a0d9-0ab14835d7ac req-79b67d84-3161-4a9e-a34d-e42a671fbb34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8f2c1b3-9d76-45f2-9d9f-919523202c6f", "tag": "ef712212-e417-4060-a1af-5f21ebb36e2b"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:02.607827 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-f76fc14e-cc00-48ce-a0d9-0ab14835d7ac req-79b67d84-3161-4a9e-a34d-e42a671fbb34 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:02.608309 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-f76fc14e-cc00-48ce-a0d9-0ab14835d7ac req-79b67d84-3161-4a9e-a34d-e42a671fbb34 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:02.608956 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-f76fc14e-cc00-48ce-a0d9-0ab14835d7ac req-79b67d84-3161-4a9e-a34d-e42a671fbb34 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:02.619604 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-f76fc14e-cc00-48ce-a0d9-0ab14835d7ac req-79b67d84-3161-4a9e-a34d-e42a671fbb34 service nova] Creating event network-changed:ef712212-e417-4060-a1af-5f21ebb36e2b for instance c8f2c1b3-9d76-45f2-9d9f-919523202c6f on hv-cinder-85221 Aug 05 20:07:02.625147 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-f76fc14e-cc00-48ce-a0d9-0ab14835d7ac req-79b67d84-3161-4a9e-a34d-e42a671fbb34 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030775 Aug 05 20:07:02.625735 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 196/401] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:07:03.180796 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-aae77355-304c-48e1-9444-f0aacc061ef7 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:03.181408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-aae77355-304c-48e1-9444-f0aacc061ef7 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:03.188874 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-aae77355-304c-48e1-9444-f0aacc061ef7 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:03.189358 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-aae77355-304c-48e1-9444-f0aacc061ef7 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:03.189789 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-aae77355-304c-48e1-9444-f0aacc061ef7 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:03.190476 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-aae77355-304c-48e1-9444-f0aacc061ef7 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:03.190926 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-aae77355-304c-48e1-9444-f0aacc061ef7 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:03.191346 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-aae77355-304c-48e1-9444-f0aacc061ef7 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:03.252290 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-aae77355-304c-48e1-9444-f0aacc061ef7 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:03.259781 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-aae77355-304c-48e1-9444-f0aacc061ef7 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1186 microversion: 2.1 time: 0.082874 Aug 05 20:07:03.260332 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 206/402] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:03 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1186 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:03.273014 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-aa7e241c-b177-42ba-b70e-e054bf0f2c96 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:03.273720 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-aa7e241c-b177-42ba-b70e-e054bf0f2c96 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:03.280090 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-aa7e241c-b177-42ba-b70e-e054bf0f2c96 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:03.280603 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-aa7e241c-b177-42ba-b70e-e054bf0f2c96 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:03.281046 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-aa7e241c-b177-42ba-b70e-e054bf0f2c96 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:03.281749 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-aa7e241c-b177-42ba-b70e-e054bf0f2c96 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:03.282212 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-aa7e241c-b177-42ba-b70e-e054bf0f2c96 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:03.282641 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-aa7e241c-b177-42ba-b70e-e054bf0f2c96 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:03.410533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-aa7e241c-b177-42ba-b70e-e054bf0f2c96 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:03.417807 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-aa7e241c-b177-42ba-b70e-e054bf0f2c96 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1314 microversion: 2.1 time: 0.149507 Aug 05 20:07:03.418942 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 197/403] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:03 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:04.281240 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-821fa271-d57c-4633-bbab-d6ea441059df tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:04.281850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-821fa271-d57c-4633-bbab-d6ea441059df tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:04.288710 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-821fa271-d57c-4633-bbab-d6ea441059df tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:04.289262 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-821fa271-d57c-4633-bbab-d6ea441059df tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:04.289710 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-821fa271-d57c-4633-bbab-d6ea441059df tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:04.290417 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-821fa271-d57c-4633-bbab-d6ea441059df tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:04.290900 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-821fa271-d57c-4633-bbab-d6ea441059df tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:04.291327 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-821fa271-d57c-4633-bbab-d6ea441059df tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:04.355298 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-821fa271-d57c-4633-bbab-d6ea441059df tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:04.363266 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-821fa271-d57c-4633-bbab-d6ea441059df tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1186 microversion: 2.1 time: 0.086544 Aug 05 20:07:04.363817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 207/404] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:04 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:04.438876 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-8b378577-2245-4f55-956d-6c362c4b3333 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:04.439393 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-8b378577-2245-4f55-956d-6c362c4b3333 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:04.445717 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8b378577-2245-4f55-956d-6c362c4b3333 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:04.446194 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8b378577-2245-4f55-956d-6c362c4b3333 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:04.446625 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8b378577-2245-4f55-956d-6c362c4b3333 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:04.447303 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8b378577-2245-4f55-956d-6c362c4b3333 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:04.447747 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8b378577-2245-4f55-956d-6c362c4b3333 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:04.448164 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8b378577-2245-4f55-956d-6c362c4b3333 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:04.577211 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8b378577-2245-4f55-956d-6c362c4b3333 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:04.584446 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-8b378577-2245-4f55-956d-6c362c4b3333 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1314 microversion: 2.1 time: 0.149498 Aug 05 20:07:04.585030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 198/405] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:04 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:05.383308 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b92ad1c7-1c67-40f9-8acb-4ca13e2683a6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:05.383920 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-b92ad1c7-1c67-40f9-8acb-4ca13e2683a6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:05.390534 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b92ad1c7-1c67-40f9-8acb-4ca13e2683a6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:05.391018 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b92ad1c7-1c67-40f9-8acb-4ca13e2683a6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:05.391453 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b92ad1c7-1c67-40f9-8acb-4ca13e2683a6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:05.392142 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b92ad1c7-1c67-40f9-8acb-4ca13e2683a6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:05.392614 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b92ad1c7-1c67-40f9-8acb-4ca13e2683a6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:05.393042 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b92ad1c7-1c67-40f9-8acb-4ca13e2683a6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:05.453435 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-b92ad1c7-1c67-40f9-8acb-4ca13e2683a6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:05.460659 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b92ad1c7-1c67-40f9-8acb-4ca13e2683a6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1186 microversion: 2.1 time: 0.081169 Aug 05 20:07:05.461346 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 208/406] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:05 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1186 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:05.606370 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-35b25c0b-3001-4384-9de4-8b296495ab5d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:05.606976 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-35b25c0b-3001-4384-9de4-8b296495ab5d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:05.613792 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-35b25c0b-3001-4384-9de4-8b296495ab5d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:05.614272 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-35b25c0b-3001-4384-9de4-8b296495ab5d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:05.614702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-35b25c0b-3001-4384-9de4-8b296495ab5d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:05.615396 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-35b25c0b-3001-4384-9de4-8b296495ab5d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:05.615845 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-35b25c0b-3001-4384-9de4-8b296495ab5d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:05.616265 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-35b25c0b-3001-4384-9de4-8b296495ab5d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:05.748632 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-35b25c0b-3001-4384-9de4-8b296495ab5d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:05.756194 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-35b25c0b-3001-4384-9de4-8b296495ab5d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1314 microversion: 2.1 time: 0.154300 Aug 05 20:07:05.756797 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 199/407] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:05 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:06.070325 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4c69f617-de18-4565-bf1b-2ec8502eec80 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1755548349", "imageRef": "c148255e-9574-4d10-b9bb-13c9411eda77", "flavorRef": "452", "networks": [{"uuid": "504733f9-86e2-4cb9-86fb-5caac1b7dbda"}]}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:06.137328 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.network.neutron [None req-4c69f617-de18-4565-bf1b-2ec8502eec80 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] validate_networks() for [('504733f9-86e2-4cb9-86fb-5caac1b7dbda', None, None, None, None, None)] {{(pid=118192) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:07:06.482294 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-060915bd-1e4c-4bc2-8a80-f19d080a1765 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:06.482805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-060915bd-1e4c-4bc2-8a80-f19d080a1765 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:06.488600 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-060915bd-1e4c-4bc2-8a80-f19d080a1765 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:06.489113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-060915bd-1e4c-4bc2-8a80-f19d080a1765 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:06.489541 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-060915bd-1e4c-4bc2-8a80-f19d080a1765 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:06.490242 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-060915bd-1e4c-4bc2-8a80-f19d080a1765 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:06.490699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-060915bd-1e4c-4bc2-8a80-f19d080a1765 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:06.491127 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-060915bd-1e4c-4bc2-8a80-f19d080a1765 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:06.592890 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-060915bd-1e4c-4bc2-8a80-f19d080a1765 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:06.600812 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-060915bd-1e4c-4bc2-8a80-f19d080a1765 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1204 microversion: 2.1 time: 0.122997 Aug 05 20:07:06.614595 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 200/408] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:06 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1204 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:06.774960 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-4c69f617-de18-4565-bf1b-2ec8502eec80 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Flavor limits 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:07:06.776085 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-4c69f617-de18-4565-bf1b-2ec8502eec80 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Image limits 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:07:06.776752 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-4c69f617-de18-4565-bf1b-2ec8502eec80 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Flavor pref 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:07:06.777065 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e93fdcfc-c878-4ef5-bf7b-d8f9dd84bd1e tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:06.777767 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-4c69f617-de18-4565-bf1b-2ec8502eec80 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Image pref 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:07:06.778145 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-4c69f617-de18-4565-bf1b-2ec8502eec80 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:07:06.778519 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e93fdcfc-c878-4ef5-bf7b-d8f9dd84bd1e tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:06.784978 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e93fdcfc-c878-4ef5-bf7b-d8f9dd84bd1e tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:06.785455 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e93fdcfc-c878-4ef5-bf7b-d8f9dd84bd1e tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:06.786063 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e93fdcfc-c878-4ef5-bf7b-d8f9dd84bd1e tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:06.786755 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e93fdcfc-c878-4ef5-bf7b-d8f9dd84bd1e tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:06.787055 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4c69f617-de18-4565-bf1b-2ec8502eec80 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:06.787197 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e93fdcfc-c878-4ef5-bf7b-d8f9dd84bd1e tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:06.787530 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4c69f617-de18-4565-bf1b-2ec8502eec80 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:06.787799 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e93fdcfc-c878-4ef5-bf7b-d8f9dd84bd1e tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:06.788128 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4c69f617-de18-4565-bf1b-2ec8502eec80 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:06.788922 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4c69f617-de18-4565-bf1b-2ec8502eec80 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:06.789371 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4c69f617-de18-4565-bf1b-2ec8502eec80 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:06.789801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4c69f617-de18-4565-bf1b-2ec8502eec80 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:06.808234 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-4c69f617-de18-4565-bf1b-2ec8502eec80 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Getting quotas for project 7a5caf50650e45fbb1872e277f56e3b3. Resources: {'cores', 'ram', 'instances'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:07:06.813636 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-4c69f617-de18-4565-bf1b-2ec8502eec80 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Getting quotas for user ac0a233c84e1413490057c64654abe99 and project 7a5caf50650e45fbb1872e277f56e3b3. Resources: {'cores', 'ram', 'instances'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:07:06.824667 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-4c69f617-de18-4565-bf1b-2ec8502eec80 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Going to run 1 instances... {{(pid=118192) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:07:06.826954 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-4c69f617-de18-4565-bf1b-2ec8502eec80 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c148255e-9574-4d10-b9bb-13c9411eda77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:07:06.882815 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-4c69f617-de18-4565-bf1b-2ec8502eec80 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.816818 Aug 05 20:07:06.883651 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 209/409] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Aug 5 20:07:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:07:06.896659 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-aab6b62c-8ffe-4de8-9c0d-4816301e39b8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:06.897289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-aab6b62c-8ffe-4de8-9c0d-4816301e39b8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:06.976718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-aab6b62c-8ffe-4de8-9c0d-4816301e39b8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:06.986911 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-aab6b62c-8ffe-4de8-9c0d-4816301e39b8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1219 microversion: 2.1 time: 0.094441 Aug 05 20:07:06.997467 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 210/410] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:06 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:07.039257 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e93fdcfc-c878-4ef5-bf7b-d8f9dd84bd1e tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:07.049386 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e93fdcfc-c878-4ef5-bf7b-d8f9dd84bd1e tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1314 microversion: 2.1 time: 0.276015 Aug 05 20:07:07.059415 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 201/411] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:06 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:07.622920 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-d6b008c5-3e49-4566-bca6-c0a416a397cc tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:07.623627 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-d6b008c5-3e49-4566-bca6-c0a416a397cc tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:07.630109 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d6b008c5-3e49-4566-bca6-c0a416a397cc tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:07.630593 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d6b008c5-3e49-4566-bca6-c0a416a397cc tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:07.631029 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d6b008c5-3e49-4566-bca6-c0a416a397cc tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:07.631716 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d6b008c5-3e49-4566-bca6-c0a416a397cc tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:07.632166 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d6b008c5-3e49-4566-bca6-c0a416a397cc tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:07.632611 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d6b008c5-3e49-4566-bca6-c0a416a397cc tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:07.766011 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-d6b008c5-3e49-4566-bca6-c0a416a397cc tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:07.773518 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-d6b008c5-3e49-4566-bca6-c0a416a397cc tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1270 microversion: 2.1 time: 0.155144 Aug 05 20:07:07.774075 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 211/412] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:07 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:08.008172 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7a0e960e-d65b-449b-a5b1-09a8a47403b2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:08.008855 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-7a0e960e-d65b-449b-a5b1-09a8a47403b2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:08.015951 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7a0e960e-d65b-449b-a5b1-09a8a47403b2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:08.016453 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7a0e960e-d65b-449b-a5b1-09a8a47403b2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:08.016951 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7a0e960e-d65b-449b-a5b1-09a8a47403b2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:08.017640 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7a0e960e-d65b-449b-a5b1-09a8a47403b2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:08.018090 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7a0e960e-d65b-449b-a5b1-09a8a47403b2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:08.018514 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7a0e960e-d65b-449b-a5b1-09a8a47403b2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:08.072635 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-c14f9678-c124-4231-afac-a095a40134da tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:08.073232 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-c14f9678-c124-4231-afac-a095a40134da tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:08.079133 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-7a0e960e-d65b-449b-a5b1-09a8a47403b2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:08.079478 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c14f9678-c124-4231-afac-a095a40134da tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:08.079991 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c14f9678-c124-4231-afac-a095a40134da tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:08.080439 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c14f9678-c124-4231-afac-a095a40134da tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:08.081136 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c14f9678-c124-4231-afac-a095a40134da tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:08.081584 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c14f9678-c124-4231-afac-a095a40134da tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:08.082012 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c14f9678-c124-4231-afac-a095a40134da tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:08.086518 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-7a0e960e-d65b-449b-a5b1-09a8a47403b2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1223 microversion: 2.1 time: 0.082253 Aug 05 20:07:08.087120 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 202/413] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:08 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:08.211882 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-c14f9678-c124-4231-afac-a095a40134da tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:08.219436 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-c14f9678-c124-4231-afac-a095a40134da tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1314 microversion: 2.1 time: 0.150589 Aug 05 20:07:08.219994 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 212/414] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:08 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:08.794891 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9b39e6df-8c8e-422d-8146-cf257a6a592c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:08.795498 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-9b39e6df-8c8e-422d-8146-cf257a6a592c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:08.801356 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9b39e6df-8c8e-422d-8146-cf257a6a592c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:08.801836 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9b39e6df-8c8e-422d-8146-cf257a6a592c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:08.802267 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9b39e6df-8c8e-422d-8146-cf257a6a592c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:08.802943 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9b39e6df-8c8e-422d-8146-cf257a6a592c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:08.803390 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9b39e6df-8c8e-422d-8146-cf257a6a592c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:08.803808 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9b39e6df-8c8e-422d-8146-cf257a6a592c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:08.937394 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9b39e6df-8c8e-422d-8146-cf257a6a592c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:08.944785 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-9b39e6df-8c8e-422d-8146-cf257a6a592c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1270 microversion: 2.1 time: 0.154591 Aug 05 20:07:08.945347 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 203/415] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:08 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:09.107264 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-7bc59718-cb78-457f-bf00-b0fe3344d36b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:09.107905 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-7bc59718-cb78-457f-bf00-b0fe3344d36b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:09.114309 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7bc59718-cb78-457f-bf00-b0fe3344d36b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:09.114796 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7bc59718-cb78-457f-bf00-b0fe3344d36b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:09.115233 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7bc59718-cb78-457f-bf00-b0fe3344d36b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:09.115926 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7bc59718-cb78-457f-bf00-b0fe3344d36b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:09.116384 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7bc59718-cb78-457f-bf00-b0fe3344d36b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:09.116837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7bc59718-cb78-457f-bf00-b0fe3344d36b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:09.179213 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-7bc59718-cb78-457f-bf00-b0fe3344d36b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:09.186743 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-7bc59718-cb78-457f-bf00-b0fe3344d36b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1223 microversion: 2.1 time: 0.083713 Aug 05 20:07:09.187301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 213/416] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:09 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:09.240084 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-d4ef4cc5-fc44-401d-9e13-0b66cfa29dfc tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:09.240725 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-d4ef4cc5-fc44-401d-9e13-0b66cfa29dfc tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:09.247195 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d4ef4cc5-fc44-401d-9e13-0b66cfa29dfc tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:09.247672 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d4ef4cc5-fc44-401d-9e13-0b66cfa29dfc tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:09.248101 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d4ef4cc5-fc44-401d-9e13-0b66cfa29dfc tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:09.248811 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d4ef4cc5-fc44-401d-9e13-0b66cfa29dfc tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:09.249257 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d4ef4cc5-fc44-401d-9e13-0b66cfa29dfc tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:09.249677 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d4ef4cc5-fc44-401d-9e13-0b66cfa29dfc tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:09.375639 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-d4ef4cc5-fc44-401d-9e13-0b66cfa29dfc tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:09.382912 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-d4ef4cc5-fc44-401d-9e13-0b66cfa29dfc tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1314 microversion: 2.1 time: 0.146624 Aug 05 20:07:09.383469 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 204/417] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:09 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:09.965765 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-30d897b5-eeab-4991-a531-b9298d6286b8 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:09.966382 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-30d897b5-eeab-4991-a531-b9298d6286b8 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:09.972377 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-30d897b5-eeab-4991-a531-b9298d6286b8 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:09.972892 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-30d897b5-eeab-4991-a531-b9298d6286b8 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:09.973333 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-30d897b5-eeab-4991-a531-b9298d6286b8 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:09.974047 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-30d897b5-eeab-4991-a531-b9298d6286b8 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:09.974502 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-30d897b5-eeab-4991-a531-b9298d6286b8 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:09.974930 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-30d897b5-eeab-4991-a531-b9298d6286b8 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:10.112283 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-30d897b5-eeab-4991-a531-b9298d6286b8 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:10.120334 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-30d897b5-eeab-4991-a531-b9298d6286b8 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1270 microversion: 2.1 time: 0.158723 Aug 05 20:07:10.121083 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 214/418] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:09 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:10.207792 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7b20830e-b64b-4697-b30d-2ca4d9e235ae tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:10.208404 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-7b20830e-b64b-4697-b30d-2ca4d9e235ae tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:10.214443 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7b20830e-b64b-4697-b30d-2ca4d9e235ae tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:10.215034 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7b20830e-b64b-4697-b30d-2ca4d9e235ae tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:10.215468 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7b20830e-b64b-4697-b30d-2ca4d9e235ae tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:10.216204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7b20830e-b64b-4697-b30d-2ca4d9e235ae tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:10.216624 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7b20830e-b64b-4697-b30d-2ca4d9e235ae tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:10.217053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7b20830e-b64b-4697-b30d-2ca4d9e235ae tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:10.277212 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-7b20830e-b64b-4697-b30d-2ca4d9e235ae tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:10.284697 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-7b20830e-b64b-4697-b30d-2ca4d9e235ae tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1223 microversion: 2.1 time: 0.080666 Aug 05 20:07:10.285334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 205/419] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:10 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:10.405670 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-c96aa491-32ad-477f-8e8c-7a1b4e108515 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:10.406930 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-c96aa491-32ad-477f-8e8c-7a1b4e108515 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:10.414014 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c96aa491-32ad-477f-8e8c-7a1b4e108515 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:10.414715 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c96aa491-32ad-477f-8e8c-7a1b4e108515 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:10.415254 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c96aa491-32ad-477f-8e8c-7a1b4e108515 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:10.416118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c96aa491-32ad-477f-8e8c-7a1b4e108515 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:10.417066 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c96aa491-32ad-477f-8e8c-7a1b4e108515 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:10.418289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c96aa491-32ad-477f-8e8c-7a1b4e108515 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:10.669105 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-c96aa491-32ad-477f-8e8c-7a1b4e108515 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:10.676407 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-c96aa491-32ad-477f-8e8c-7a1b4e108515 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1314 microversion: 2.1 time: 0.276019 Aug 05 20:07:10.677005 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 215/420] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:10 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:10.987526 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-9033bd96-26e9-4d1c-88e1-ee41c79dd08d req-2a187b29-7fbd-43cb-bed1-56d2245b68c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5559da3c-05e6-432d-960c-67c53284cc54", "tag": "5e5897da-174c-4054-8f66-ed7648322749"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:10.993369 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=4 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:11.000078 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-9033bd96-26e9-4d1c-88e1-ee41c79dd08d req-2a187b29-7fbd-43cb-bed1-56d2245b68c7 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:11.000882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-9033bd96-26e9-4d1c-88e1-ee41c79dd08d req-2a187b29-7fbd-43cb-bed1-56d2245b68c7 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:11.001452 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-9033bd96-26e9-4d1c-88e1-ee41c79dd08d req-2a187b29-7fbd-43cb-bed1-56d2245b68c7 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:11.014249 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-9033bd96-26e9-4d1c-88e1-ee41c79dd08d req-2a187b29-7fbd-43cb-bed1-56d2245b68c7 service nova] Creating event network-changed:5e5897da-174c-4054-8f66-ed7648322749 for instance 5559da3c-05e6-432d-960c-67c53284cc54 on hv-cinder-85221 Aug 05 20:07:11.019721 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-9033bd96-26e9-4d1c-88e1-ee41c79dd08d req-2a187b29-7fbd-43cb-bed1-56d2245b68c7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036028 Aug 05 20:07:11.020797 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 206/421] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:07:11.142040 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-d83af716-1cf4-443f-8a29-88d8e6f13fc6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:11.142663 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-d83af716-1cf4-443f-8a29-88d8e6f13fc6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:11.150171 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d83af716-1cf4-443f-8a29-88d8e6f13fc6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:11.150766 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d83af716-1cf4-443f-8a29-88d8e6f13fc6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:11.151215 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d83af716-1cf4-443f-8a29-88d8e6f13fc6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:11.152562 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d83af716-1cf4-443f-8a29-88d8e6f13fc6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:11.153041 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d83af716-1cf4-443f-8a29-88d8e6f13fc6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:11.153834 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d83af716-1cf4-443f-8a29-88d8e6f13fc6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:11.289819 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-d83af716-1cf4-443f-8a29-88d8e6f13fc6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:11.297407 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-d83af716-1cf4-443f-8a29-88d8e6f13fc6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1270 microversion: 2.1 time: 0.160492 Aug 05 20:07:11.298081 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 216/422] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:11 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:11.301308 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=14 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:11.305895 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-78e28cb5-3778-4a16-9d0d-b56ff63b33d6 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:11.306593 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-78e28cb5-3778-4a16-9d0d-b56ff63b33d6 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:11.313637 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-78e28cb5-3778-4a16-9d0d-b56ff63b33d6 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:11.314118 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-78e28cb5-3778-4a16-9d0d-b56ff63b33d6 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:11.314551 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-78e28cb5-3778-4a16-9d0d-b56ff63b33d6 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:11.315235 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-78e28cb5-3778-4a16-9d0d-b56ff63b33d6 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:11.315688 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-78e28cb5-3778-4a16-9d0d-b56ff63b33d6 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:11.316111 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-78e28cb5-3778-4a16-9d0d-b56ff63b33d6 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:11.382309 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-78e28cb5-3778-4a16-9d0d-b56ff63b33d6 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:11.391428 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-78e28cb5-3778-4a16-9d0d-b56ff63b33d6 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1289 microversion: 2.1 time: 0.091001 Aug 05 20:07:11.392082 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 207/423] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:11 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:11.697928 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-cca06776-1d2b-4592-b6bc-571d134f86c4 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:11.698563 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-cca06776-1d2b-4592-b6bc-571d134f86c4 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:11.705108 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cca06776-1d2b-4592-b6bc-571d134f86c4 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:11.705592 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cca06776-1d2b-4592-b6bc-571d134f86c4 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:11.706022 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cca06776-1d2b-4592-b6bc-571d134f86c4 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:11.706700 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cca06776-1d2b-4592-b6bc-571d134f86c4 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:11.707146 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cca06776-1d2b-4592-b6bc-571d134f86c4 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:11.707564 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cca06776-1d2b-4592-b6bc-571d134f86c4 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:11.837372 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-cca06776-1d2b-4592-b6bc-571d134f86c4 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:11.844727 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-cca06776-1d2b-4592-b6bc-571d134f86c4 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1314 microversion: 2.1 time: 0.150763 Aug 05 20:07:11.845291 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 217/424] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:11 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:12.318677 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-5226c85a-4dc4-4d12-89c6-80f37b19826e tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:12.319321 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-5226c85a-4dc4-4d12-89c6-80f37b19826e tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:12.326208 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5226c85a-4dc4-4d12-89c6-80f37b19826e tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:12.326694 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5226c85a-4dc4-4d12-89c6-80f37b19826e tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:12.327123 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5226c85a-4dc4-4d12-89c6-80f37b19826e tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:12.327840 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5226c85a-4dc4-4d12-89c6-80f37b19826e tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:12.328294 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5226c85a-4dc4-4d12-89c6-80f37b19826e tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:12.328755 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5226c85a-4dc4-4d12-89c6-80f37b19826e tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:12.412387 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-345e4c26-c9c2-4fb6-a380-39eb01858004 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:12.413518 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-345e4c26-c9c2-4fb6-a380-39eb01858004 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:12.420447 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-345e4c26-c9c2-4fb6-a380-39eb01858004 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:12.421032 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-345e4c26-c9c2-4fb6-a380-39eb01858004 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:12.421474 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-345e4c26-c9c2-4fb6-a380-39eb01858004 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:12.422182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-345e4c26-c9c2-4fb6-a380-39eb01858004 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:12.422638 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-345e4c26-c9c2-4fb6-a380-39eb01858004 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:12.423070 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-345e4c26-c9c2-4fb6-a380-39eb01858004 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:12.481454 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-5226c85a-4dc4-4d12-89c6-80f37b19826e tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:12.489384 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-5226c85a-4dc4-4d12-89c6-80f37b19826e tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1270 microversion: 2.1 time: 0.174604 Aug 05 20:07:12.489960 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 208/425] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:12 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:12.498596 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-345e4c26-c9c2-4fb6-a380-39eb01858004 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:12.506245 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-345e4c26-c9c2-4fb6-a380-39eb01858004 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1289 microversion: 2.1 time: 0.097762 Aug 05 20:07:12.506876 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 218/426] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:12 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:12.866599 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-0ee40e02-d5fd-4fd5-b351-6d5257c8fd7a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:12.867127 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-0ee40e02-d5fd-4fd5-b351-6d5257c8fd7a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:12.873309 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0ee40e02-d5fd-4fd5-b351-6d5257c8fd7a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:12.873789 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0ee40e02-d5fd-4fd5-b351-6d5257c8fd7a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:12.874220 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0ee40e02-d5fd-4fd5-b351-6d5257c8fd7a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:12.874901 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0ee40e02-d5fd-4fd5-b351-6d5257c8fd7a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:12.875349 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0ee40e02-d5fd-4fd5-b351-6d5257c8fd7a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:12.875768 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0ee40e02-d5fd-4fd5-b351-6d5257c8fd7a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:13.003203 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-0ee40e02-d5fd-4fd5-b351-6d5257c8fd7a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:13.010530 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-0ee40e02-d5fd-4fd5-b351-6d5257c8fd7a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1314 microversion: 2.1 time: 0.147845 Aug 05 20:07:13.011085 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 209/427] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:12 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:13.510507 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-8f3a3a66-c6e5-495c-8412-30d359919aa0 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:13.511314 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-8f3a3a66-c6e5-495c-8412-30d359919aa0 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:13.524364 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8f3a3a66-c6e5-495c-8412-30d359919aa0 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:13.524904 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8f3a3a66-c6e5-495c-8412-30d359919aa0 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:13.525350 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8f3a3a66-c6e5-495c-8412-30d359919aa0 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:13.526090 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8f3a3a66-c6e5-495c-8412-30d359919aa0 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:13.526543 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8f3a3a66-c6e5-495c-8412-30d359919aa0 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:13.526969 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8f3a3a66-c6e5-495c-8412-30d359919aa0 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:13.528664 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-b62d4098-6f2a-40a8-981d-15cbbb6b356d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:13.529357 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-b62d4098-6f2a-40a8-981d-15cbbb6b356d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:13.537110 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b62d4098-6f2a-40a8-981d-15cbbb6b356d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:13.537700 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b62d4098-6f2a-40a8-981d-15cbbb6b356d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:13.538213 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b62d4098-6f2a-40a8-981d-15cbbb6b356d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:13.538928 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b62d4098-6f2a-40a8-981d-15cbbb6b356d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:13.539399 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b62d4098-6f2a-40a8-981d-15cbbb6b356d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:13.539827 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b62d4098-6f2a-40a8-981d-15cbbb6b356d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:13.629739 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-b62d4098-6f2a-40a8-981d-15cbbb6b356d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:13.638494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-b62d4098-6f2a-40a8-981d-15cbbb6b356d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1289 microversion: 2.1 time: 0.114666 Aug 05 20:07:13.646535 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 210/428] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:13 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1289 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:13.707779 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-8f3a3a66-c6e5-495c-8412-30d359919aa0 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:13.716674 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-8f3a3a66-c6e5-495c-8412-30d359919aa0 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1270 microversion: 2.1 time: 0.210974 Aug 05 20:07:13.717591 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 219/429] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:13 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1270 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:14.031885 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-4f48fa9e-d41e-4908-87b7-b9dae06a2e03 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:14.032532 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-4f48fa9e-d41e-4908-87b7-b9dae06a2e03 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:14.038981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4f48fa9e-d41e-4908-87b7-b9dae06a2e03 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:14.039473 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4f48fa9e-d41e-4908-87b7-b9dae06a2e03 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:14.039916 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4f48fa9e-d41e-4908-87b7-b9dae06a2e03 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:14.040636 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4f48fa9e-d41e-4908-87b7-b9dae06a2e03 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:14.041093 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4f48fa9e-d41e-4908-87b7-b9dae06a2e03 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:14.041518 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4f48fa9e-d41e-4908-87b7-b9dae06a2e03 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:14.197091 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-4f48fa9e-d41e-4908-87b7-b9dae06a2e03 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:14.205381 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-4f48fa9e-d41e-4908-87b7-b9dae06a2e03 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1314 microversion: 2.1 time: 0.177910 Aug 05 20:07:14.205985 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 211/430] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:14 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:14.660241 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-1c6ca368-e2f6-48fd-a705-02c16c06a6cb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:14.660849 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-1c6ca368-e2f6-48fd-a705-02c16c06a6cb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:14.667749 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1c6ca368-e2f6-48fd-a705-02c16c06a6cb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:14.668971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1c6ca368-e2f6-48fd-a705-02c16c06a6cb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:14.669806 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1c6ca368-e2f6-48fd-a705-02c16c06a6cb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:14.670893 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1c6ca368-e2f6-48fd-a705-02c16c06a6cb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:14.671353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1c6ca368-e2f6-48fd-a705-02c16c06a6cb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:14.671782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1c6ca368-e2f6-48fd-a705-02c16c06a6cb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:14.738842 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e12acd16-d681-452f-b1e6-590ab4a8160f tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:14.740307 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e12acd16-d681-452f-b1e6-590ab4a8160f tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:14.748165 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e12acd16-d681-452f-b1e6-590ab4a8160f tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:14.748709 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e12acd16-d681-452f-b1e6-590ab4a8160f tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:14.749110 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e12acd16-d681-452f-b1e6-590ab4a8160f tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:14.750019 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e12acd16-d681-452f-b1e6-590ab4a8160f tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:14.750450 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e12acd16-d681-452f-b1e6-590ab4a8160f tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:14.750864 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e12acd16-d681-452f-b1e6-590ab4a8160f tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:14.755305 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=100 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:14.820978 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-1c6ca368-e2f6-48fd-a705-02c16c06a6cb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:14.831533 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-1c6ca368-e2f6-48fd-a705-02c16c06a6cb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1277 microversion: 2.1 time: 0.175051 Aug 05 20:07:14.837946 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 220/431] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:14 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1277 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:14.962501 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e12acd16-d681-452f-b1e6-590ab4a8160f tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:14.970996 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e12acd16-d681-452f-b1e6-590ab4a8160f tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1270 microversion: 2.1 time: 0.236705 Aug 05 20:07:14.971579 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 212/432] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:14 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1270 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:15.226667 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-647242ff-7756-4a10-947f-f27012ea2372 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:15.227394 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-647242ff-7756-4a10-947f-f27012ea2372 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:15.235311 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-647242ff-7756-4a10-947f-f27012ea2372 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:15.235910 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-647242ff-7756-4a10-947f-f27012ea2372 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:15.236446 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-647242ff-7756-4a10-947f-f27012ea2372 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:15.237262 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-647242ff-7756-4a10-947f-f27012ea2372 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:15.237812 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-647242ff-7756-4a10-947f-f27012ea2372 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:15.238321 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-647242ff-7756-4a10-947f-f27012ea2372 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:15.531669 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-647242ff-7756-4a10-947f-f27012ea2372 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:15.540762 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-647242ff-7756-4a10-947f-f27012ea2372 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1314 microversion: 2.1 time: 0.317866 Aug 05 20:07:15.541346 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 221/433] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:15 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:15.707207 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-2dae38da-6c02-4a74-a782-399c67bf407e req-9d87cc55-8dd5-4f4e-bc84-43eba47c38ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daea58f2-4fe8-42e5-afdb-c0b8d47b963c", "tag": "dd4c2340-2e4a-4630-b9ee-b8953b613c7a"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:15.719812 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-2dae38da-6c02-4a74-a782-399c67bf407e req-9d87cc55-8dd5-4f4e-bc84-43eba47c38ed service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:15.720269 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-2dae38da-6c02-4a74-a782-399c67bf407e req-9d87cc55-8dd5-4f4e-bc84-43eba47c38ed service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:15.720737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-2dae38da-6c02-4a74-a782-399c67bf407e req-9d87cc55-8dd5-4f4e-bc84-43eba47c38ed service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:15.731814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-2dae38da-6c02-4a74-a782-399c67bf407e req-9d87cc55-8dd5-4f4e-bc84-43eba47c38ed service nova] Creating event network-changed:dd4c2340-2e4a-4630-b9ee-b8953b613c7a for instance daea58f2-4fe8-42e5-afdb-c0b8d47b963c on hv-cinder-85221 Aug 05 20:07:15.736869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-2dae38da-6c02-4a74-a782-399c67bf407e req-9d87cc55-8dd5-4f4e-bc84-43eba47c38ed service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033489 Aug 05 20:07:15.737453 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 213/434] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:07:15.854124 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-38541bc5-acdd-4b82-b059-27f387a94ff1 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:15.854733 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-38541bc5-acdd-4b82-b059-27f387a94ff1 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:15.861009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-38541bc5-acdd-4b82-b059-27f387a94ff1 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:15.861489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-38541bc5-acdd-4b82-b059-27f387a94ff1 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:15.861929 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-38541bc5-acdd-4b82-b059-27f387a94ff1 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:15.862608 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-38541bc5-acdd-4b82-b059-27f387a94ff1 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:15.863057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-38541bc5-acdd-4b82-b059-27f387a94ff1 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:15.863478 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-38541bc5-acdd-4b82-b059-27f387a94ff1 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:15.867381 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=100 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:15.993040 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-bf1c4d92-8b48-4c6e-b7ba-81dfddb49574 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:15.994390 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-bf1c4d92-8b48-4c6e-b7ba-81dfddb49574 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:15.995429 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-38541bc5-acdd-4b82-b059-27f387a94ff1 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:16.001081 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bf1c4d92-8b48-4c6e-b7ba-81dfddb49574 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:16.001577 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bf1c4d92-8b48-4c6e-b7ba-81dfddb49574 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:16.002041 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bf1c4d92-8b48-4c6e-b7ba-81dfddb49574 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:16.002737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bf1c4d92-8b48-4c6e-b7ba-81dfddb49574 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:16.003194 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bf1c4d92-8b48-4c6e-b7ba-81dfddb49574 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:16.003618 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bf1c4d92-8b48-4c6e-b7ba-81dfddb49574 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:16.003893 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-38541bc5-acdd-4b82-b059-27f387a94ff1 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1319 microversion: 2.1 time: 0.153539 Aug 05 20:07:16.004460 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 222/435] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:15 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:16.140520 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-bf1c4d92-8b48-4c6e-b7ba-81dfddb49574 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:16.148035 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-bf1c4d92-8b48-4c6e-b7ba-81dfddb49574 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1258 microversion: 2.1 time: 0.159224 Aug 05 20:07:16.148619 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 214/436] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:15 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:16.561742 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-5e2b67df-d0a3-41c7-b666-17eb1a061caf tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:16.562296 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-5e2b67df-d0a3-41c7-b666-17eb1a061caf tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:16.568109 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5e2b67df-d0a3-41c7-b666-17eb1a061caf tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:16.568620 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5e2b67df-d0a3-41c7-b666-17eb1a061caf tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:16.569064 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5e2b67df-d0a3-41c7-b666-17eb1a061caf tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:16.569749 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5e2b67df-d0a3-41c7-b666-17eb1a061caf tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:16.570211 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5e2b67df-d0a3-41c7-b666-17eb1a061caf tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:16.570632 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5e2b67df-d0a3-41c7-b666-17eb1a061caf tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:16.697779 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-5e2b67df-d0a3-41c7-b666-17eb1a061caf tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:16.705645 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-5e2b67df-d0a3-41c7-b666-17eb1a061caf tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1314 microversion: 2.1 time: 0.147768 Aug 05 20:07:16.706205 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 223/437] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:16 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:17.026672 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-edb4b6c8-c74f-4b4a-ba4a-29a45cd601bb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:17.027993 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-edb4b6c8-c74f-4b4a-ba4a-29a45cd601bb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:17.036043 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-edb4b6c8-c74f-4b4a-ba4a-29a45cd601bb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:17.036555 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-edb4b6c8-c74f-4b4a-ba4a-29a45cd601bb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:17.036999 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-edb4b6c8-c74f-4b4a-ba4a-29a45cd601bb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:17.037716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-edb4b6c8-c74f-4b4a-ba4a-29a45cd601bb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:17.038161 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-edb4b6c8-c74f-4b4a-ba4a-29a45cd601bb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:17.038863 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-edb4b6c8-c74f-4b4a-ba4a-29a45cd601bb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:17.173215 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4789444c-4564-46bf-9031-0ec541df3219 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:17.174610 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-4789444c-4564-46bf-9031-0ec541df3219 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:17.177696 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell0:SELECT=2 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:17.180214 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell0:SELECT=10 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:17.193811 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4789444c-4564-46bf-9031-0ec541df3219 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:17.195460 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4789444c-4564-46bf-9031-0ec541df3219 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:17.196261 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4789444c-4564-46bf-9031-0ec541df3219 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:17.197469 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4789444c-4564-46bf-9031-0ec541df3219 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:17.198217 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4789444c-4564-46bf-9031-0ec541df3219 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:17.200310 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4789444c-4564-46bf-9031-0ec541df3219 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:17.292415 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-edb4b6c8-c74f-4b4a-ba4a-29a45cd601bb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:17.305210 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-edb4b6c8-c74f-4b4a-ba4a-29a45cd601bb tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1319 microversion: 2.1 time: 0.283388 Aug 05 20:07:17.311500 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 215/438] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:17 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:17.506674 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-4789444c-4564-46bf-9031-0ec541df3219 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:17.515985 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-4789444c-4564-46bf-9031-0ec541df3219 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1258 microversion: 2.1 time: 0.350977 Aug 05 20:07:17.516708 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 224/439] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:17 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1258 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:17.728539 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-31266f44-0a14-4f4f-880b-b1233d732b1f tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:17.729387 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-31266f44-0a14-4f4f-880b-b1233d732b1f tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:17.736031 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-31266f44-0a14-4f4f-880b-b1233d732b1f tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:17.736739 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-31266f44-0a14-4f4f-880b-b1233d732b1f tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:17.737922 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-31266f44-0a14-4f4f-880b-b1233d732b1f tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:17.738928 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-31266f44-0a14-4f4f-880b-b1233d732b1f tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:17.739492 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-31266f44-0a14-4f4f-880b-b1233d732b1f tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:17.740024 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-31266f44-0a14-4f4f-880b-b1233d732b1f tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:18.050419 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-31266f44-0a14-4f4f-880b-b1233d732b1f tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:18.057852 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-31266f44-0a14-4f4f-880b-b1233d732b1f tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1314 microversion: 2.1 time: 0.334448 Aug 05 20:07:18.058416 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 216/440] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:17 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:18.331433 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-698762ba-7115-474a-b4d9-4bcb906e203c tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:18.332050 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-698762ba-7115-474a-b4d9-4bcb906e203c tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:18.338407 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-698762ba-7115-474a-b4d9-4bcb906e203c tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:18.338893 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-698762ba-7115-474a-b4d9-4bcb906e203c tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:18.339438 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-698762ba-7115-474a-b4d9-4bcb906e203c tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:18.340248 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-698762ba-7115-474a-b4d9-4bcb906e203c tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:18.340739 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-698762ba-7115-474a-b4d9-4bcb906e203c tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:18.341167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-698762ba-7115-474a-b4d9-4bcb906e203c tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:18.478475 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-698762ba-7115-474a-b4d9-4bcb906e203c tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:18.484633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-698762ba-7115-474a-b4d9-4bcb906e203c tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1319 microversion: 2.1 time: 0.156932 Aug 05 20:07:18.485203 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 225/441] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:18 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:18.537310 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9895c631-3cd6-4dc4-aea7-5dc298a6e57b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:18.538179 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-9895c631-3cd6-4dc4-aea7-5dc298a6e57b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:18.545604 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9895c631-3cd6-4dc4-aea7-5dc298a6e57b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:18.546093 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9895c631-3cd6-4dc4-aea7-5dc298a6e57b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:18.546530 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9895c631-3cd6-4dc4-aea7-5dc298a6e57b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:18.547224 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9895c631-3cd6-4dc4-aea7-5dc298a6e57b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:18.547678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9895c631-3cd6-4dc4-aea7-5dc298a6e57b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:18.548103 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9895c631-3cd6-4dc4-aea7-5dc298a6e57b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:18.687823 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9895c631-3cd6-4dc4-aea7-5dc298a6e57b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:18.695378 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-9895c631-3cd6-4dc4-aea7-5dc298a6e57b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1258 microversion: 2.1 time: 0.161943 Aug 05 20:07:18.695976 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 217/442] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:18 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:19.078609 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-e7f356ec-48e1-46db-b3b2-945fcedaf39a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:19.079495 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-e7f356ec-48e1-46db-b3b2-945fcedaf39a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:19.085477 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e7f356ec-48e1-46db-b3b2-945fcedaf39a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:19.086277 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e7f356ec-48e1-46db-b3b2-945fcedaf39a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:19.086787 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e7f356ec-48e1-46db-b3b2-945fcedaf39a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:19.087790 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e7f356ec-48e1-46db-b3b2-945fcedaf39a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:19.088275 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e7f356ec-48e1-46db-b3b2-945fcedaf39a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:19.088866 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e7f356ec-48e1-46db-b3b2-945fcedaf39a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:19.213172 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-d966bbaf-3fca-49af-b012-edd49576fe46 req-77d93f1b-003c-43ac-9c51-2a00a2d05c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f2c1b3-9d76-45f2-9d9f-919523202c6f", "name": "network-vif-plugged", "status": "completed", "tag": "ef712212-e417-4060-a1af-5f21ebb36e2b"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:19.228966 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-d966bbaf-3fca-49af-b012-edd49576fe46 req-77d93f1b-003c-43ac-9c51-2a00a2d05c5f service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:19.229617 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-d966bbaf-3fca-49af-b012-edd49576fe46 req-77d93f1b-003c-43ac-9c51-2a00a2d05c5f service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:19.231524 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-d966bbaf-3fca-49af-b012-edd49576fe46 req-77d93f1b-003c-43ac-9c51-2a00a2d05c5f service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:19.270498 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-d966bbaf-3fca-49af-b012-edd49576fe46 req-77d93f1b-003c-43ac-9c51-2a00a2d05c5f service nova] Creating event network-vif-plugged:ef712212-e417-4060-a1af-5f21ebb36e2b for instance c8f2c1b3-9d76-45f2-9d9f-919523202c6f on hv-cinder-85221 Aug 05 20:07:19.277397 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-d966bbaf-3fca-49af-b012-edd49576fe46 req-77d93f1b-003c-43ac-9c51-2a00a2d05c5f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068015 Aug 05 20:07:19.278067 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 218/443] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:07:19.311779 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-e7f356ec-48e1-46db-b3b2-945fcedaf39a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:19.320534 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-e7f356ec-48e1-46db-b3b2-945fcedaf39a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1314 microversion: 2.1 time: 0.245759 Aug 05 20:07:19.321370 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 226/444] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:19 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:19.506950 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-351507de-a288-4edd-87e4-d303d6adc1be tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:19.507653 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-351507de-a288-4edd-87e4-d303d6adc1be tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:19.514509 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-351507de-a288-4edd-87e4-d303d6adc1be tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:19.515259 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-351507de-a288-4edd-87e4-d303d6adc1be tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:19.515701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-351507de-a288-4edd-87e4-d303d6adc1be tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:19.516402 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-351507de-a288-4edd-87e4-d303d6adc1be tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:19.516925 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-351507de-a288-4edd-87e4-d303d6adc1be tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:19.517458 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-351507de-a288-4edd-87e4-d303d6adc1be tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:19.676645 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-351507de-a288-4edd-87e4-d303d6adc1be tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:19.684671 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-351507de-a288-4edd-87e4-d303d6adc1be tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1319 microversion: 2.1 time: 0.181898 Aug 05 20:07:19.685363 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 219/445] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:19 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:19.718872 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-76b5c22d-8a1d-4d73-bf04-e710ef9126df tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:19.720266 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-76b5c22d-8a1d-4d73-bf04-e710ef9126df tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:19.728219 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-76b5c22d-8a1d-4d73-bf04-e710ef9126df tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:19.729371 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-76b5c22d-8a1d-4d73-bf04-e710ef9126df tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:19.729813 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-76b5c22d-8a1d-4d73-bf04-e710ef9126df tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:19.730545 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-76b5c22d-8a1d-4d73-bf04-e710ef9126df tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:19.731439 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-76b5c22d-8a1d-4d73-bf04-e710ef9126df tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:19.731867 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-76b5c22d-8a1d-4d73-bf04-e710ef9126df tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:19.878674 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-76b5c22d-8a1d-4d73-bf04-e710ef9126df tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:19.887530 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-76b5c22d-8a1d-4d73-bf04-e710ef9126df tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1258 microversion: 2.1 time: 0.174089 Aug 05 20:07:19.888113 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 227/446] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:19 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1258 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:20.347897 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-5b06ef84-c698-4786-87dc-68e716662dc9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:20.349245 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-5b06ef84-c698-4786-87dc-68e716662dc9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:20.356694 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5b06ef84-c698-4786-87dc-68e716662dc9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:20.357192 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5b06ef84-c698-4786-87dc-68e716662dc9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:20.357631 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5b06ef84-c698-4786-87dc-68e716662dc9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:20.358332 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5b06ef84-c698-4786-87dc-68e716662dc9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:20.358789 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5b06ef84-c698-4786-87dc-68e716662dc9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:20.359215 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5b06ef84-c698-4786-87dc-68e716662dc9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:20.513839 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-5b06ef84-c698-4786-87dc-68e716662dc9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:20.522000 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-5b06ef84-c698-4786-87dc-68e716662dc9 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1314 microversion: 2.1 time: 0.178345 Aug 05 20:07:20.522592 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 220/447] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:20 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:20.706116 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a40a541d-ecf5-4e2c-88d4-fb851326d4b9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:20.706738 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a40a541d-ecf5-4e2c-88d4-fb851326d4b9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:20.713128 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a40a541d-ecf5-4e2c-88d4-fb851326d4b9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:20.713897 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a40a541d-ecf5-4e2c-88d4-fb851326d4b9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:20.714375 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a40a541d-ecf5-4e2c-88d4-fb851326d4b9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:20.715844 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a40a541d-ecf5-4e2c-88d4-fb851326d4b9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:20.716346 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a40a541d-ecf5-4e2c-88d4-fb851326d4b9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:20.716867 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a40a541d-ecf5-4e2c-88d4-fb851326d4b9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:20.864669 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a40a541d-ecf5-4e2c-88d4-fb851326d4b9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:20.872941 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a40a541d-ecf5-4e2c-88d4-fb851326d4b9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1319 microversion: 2.1 time: 0.170646 Aug 05 20:07:20.873522 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 228/448] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:20 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:20.908546 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-0b620f01-8ce1-411c-b2ce-50adb9a604f3 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:20.909203 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-0b620f01-8ce1-411c-b2ce-50adb9a604f3 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:20.915753 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0b620f01-8ce1-411c-b2ce-50adb9a604f3 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:20.916327 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0b620f01-8ce1-411c-b2ce-50adb9a604f3 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:20.917058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0b620f01-8ce1-411c-b2ce-50adb9a604f3 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:20.919160 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0b620f01-8ce1-411c-b2ce-50adb9a604f3 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:20.919661 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0b620f01-8ce1-411c-b2ce-50adb9a604f3 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:20.920281 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0b620f01-8ce1-411c-b2ce-50adb9a604f3 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:21.094060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-0b620f01-8ce1-411c-b2ce-50adb9a604f3 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:21.104331 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-0b620f01-8ce1-411c-b2ce-50adb9a604f3 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1258 microversion: 2.1 time: 0.199733 Aug 05 20:07:21.113724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 221/449] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:20 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1258 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:21.543306 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a7995c4e-da61-4156-9957-4b4500a47f20 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:21.544451 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a7995c4e-da61-4156-9957-4b4500a47f20 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:21.551883 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a7995c4e-da61-4156-9957-4b4500a47f20 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:21.552515 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a7995c4e-da61-4156-9957-4b4500a47f20 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:21.553100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a7995c4e-da61-4156-9957-4b4500a47f20 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:21.554016 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a7995c4e-da61-4156-9957-4b4500a47f20 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:21.554578 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a7995c4e-da61-4156-9957-4b4500a47f20 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:21.555097 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a7995c4e-da61-4156-9957-4b4500a47f20 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:21.786189 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a7995c4e-da61-4156-9957-4b4500a47f20 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:21.799345 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a7995c4e-da61-4156-9957-4b4500a47f20 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1314 microversion: 2.1 time: 0.259403 Aug 05 20:07:21.800514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 229/450] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:21 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:21.899579 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-c05c3d00-717b-4c24-a930-06cf22a58b34 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:21.901010 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-c05c3d00-717b-4c24-a930-06cf22a58b34 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:21.911173 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c05c3d00-717b-4c24-a930-06cf22a58b34 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:21.911960 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c05c3d00-717b-4c24-a930-06cf22a58b34 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:21.912561 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c05c3d00-717b-4c24-a930-06cf22a58b34 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:21.914799 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c05c3d00-717b-4c24-a930-06cf22a58b34 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:21.915434 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c05c3d00-717b-4c24-a930-06cf22a58b34 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:21.916029 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c05c3d00-717b-4c24-a930-06cf22a58b34 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:22.137388 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ea8cb307-f799-420b-bc65-7fc9383f2a05 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:22.138005 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-ea8cb307-f799-420b-bc65-7fc9383f2a05 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:22.149756 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ea8cb307-f799-420b-bc65-7fc9383f2a05 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:22.150279 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ea8cb307-f799-420b-bc65-7fc9383f2a05 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:22.150868 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ea8cb307-f799-420b-bc65-7fc9383f2a05 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:22.151588 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ea8cb307-f799-420b-bc65-7fc9383f2a05 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:22.152827 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ea8cb307-f799-420b-bc65-7fc9383f2a05 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:22.153435 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ea8cb307-f799-420b-bc65-7fc9383f2a05 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:22.159670 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-c05c3d00-717b-4c24-a930-06cf22a58b34 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:22.169075 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-c05c3d00-717b-4c24-a930-06cf22a58b34 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1319 microversion: 2.1 time: 0.276262 Aug 05 20:07:22.170438 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 222/451] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:21 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:22.379038 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-ea8cb307-f799-420b-bc65-7fc9383f2a05 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:22.387603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-ea8cb307-f799-420b-bc65-7fc9383f2a05 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1258 microversion: 2.1 time: 0.255670 Aug 05 20:07:22.388076 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 230/452] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:22 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1258 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:22.820924 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7cb911e9-367e-4ad5-b6aa-c90a0153f532 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:22.821677 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-7cb911e9-367e-4ad5-b6aa-c90a0153f532 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:22.828619 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7cb911e9-367e-4ad5-b6aa-c90a0153f532 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:22.829414 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7cb911e9-367e-4ad5-b6aa-c90a0153f532 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:22.830072 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7cb911e9-367e-4ad5-b6aa-c90a0153f532 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:22.831124 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7cb911e9-367e-4ad5-b6aa-c90a0153f532 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:22.832149 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7cb911e9-367e-4ad5-b6aa-c90a0153f532 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:22.833165 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7cb911e9-367e-4ad5-b6aa-c90a0153f532 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:23.191576 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-eb5c6971-4a78-4b9a-9018-ba0e95f9b2f2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:23.195112 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-eb5c6971-4a78-4b9a-9018-ba0e95f9b2f2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:23.202309 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eb5c6971-4a78-4b9a-9018-ba0e95f9b2f2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:23.202953 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eb5c6971-4a78-4b9a-9018-ba0e95f9b2f2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:23.203696 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eb5c6971-4a78-4b9a-9018-ba0e95f9b2f2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:23.204508 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eb5c6971-4a78-4b9a-9018-ba0e95f9b2f2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:23.205254 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eb5c6971-4a78-4b9a-9018-ba0e95f9b2f2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:23.205630 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eb5c6971-4a78-4b9a-9018-ba0e95f9b2f2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:23.374730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-7cb911e9-367e-4ad5-b6aa-c90a0153f532 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:23.382642 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-7cb911e9-367e-4ad5-b6aa-c90a0153f532 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1314 microversion: 2.1 time: 0.565892 Aug 05 20:07:23.397042 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 223/453] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:22 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:23.407397 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-353c3e55-9c01-4599-bfd0-99f96f16b739 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:23.408007 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-353c3e55-9c01-4599-bfd0-99f96f16b739 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:23.414700 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-353c3e55-9c01-4599-bfd0-99f96f16b739 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:23.415238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-353c3e55-9c01-4599-bfd0-99f96f16b739 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:23.415672 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-353c3e55-9c01-4599-bfd0-99f96f16b739 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:23.416360 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-353c3e55-9c01-4599-bfd0-99f96f16b739 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:23.417001 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-353c3e55-9c01-4599-bfd0-99f96f16b739 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:23.418167 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-353c3e55-9c01-4599-bfd0-99f96f16b739 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:23.478029 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-eb5c6971-4a78-4b9a-9018-ba0e95f9b2f2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:23.498760 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-eb5c6971-4a78-4b9a-9018-ba0e95f9b2f2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1319 microversion: 2.1 time: 0.311453 Aug 05 20:07:23.500026 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 231/454] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:23 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:23.654670 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-353c3e55-9c01-4599-bfd0-99f96f16b739 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:23.663043 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-353c3e55-9c01-4599-bfd0-99f96f16b739 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1258 microversion: 2.1 time: 0.259400 Aug 05 20:07:23.664204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 224/455] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:23 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1258 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:24.406800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b137fb2f-2e09-48ed-bb0c-70e95209424d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:24.408846 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-b137fb2f-2e09-48ed-bb0c-70e95209424d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:24.415555 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b137fb2f-2e09-48ed-bb0c-70e95209424d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:24.416105 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b137fb2f-2e09-48ed-bb0c-70e95209424d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:24.416654 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b137fb2f-2e09-48ed-bb0c-70e95209424d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:24.418472 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b137fb2f-2e09-48ed-bb0c-70e95209424d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:24.419112 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b137fb2f-2e09-48ed-bb0c-70e95209424d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:24.419538 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b137fb2f-2e09-48ed-bb0c-70e95209424d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:24.521233 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-bc35e3fc-8f4f-49ef-9aa4-f3a1a426a2ff tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:24.521852 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-bc35e3fc-8f4f-49ef-9aa4-f3a1a426a2ff tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:24.528789 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:24.530548 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bc35e3fc-8f4f-49ef-9aa4-f3a1a426a2ff tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:24.531046 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bc35e3fc-8f4f-49ef-9aa4-f3a1a426a2ff tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:24.531475 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bc35e3fc-8f4f-49ef-9aa4-f3a1a426a2ff tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:24.532396 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bc35e3fc-8f4f-49ef-9aa4-f3a1a426a2ff tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:24.533035 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bc35e3fc-8f4f-49ef-9aa4-f3a1a426a2ff tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:24.533640 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bc35e3fc-8f4f-49ef-9aa4-f3a1a426a2ff tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:24.722692 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-b137fb2f-2e09-48ed-bb0c-70e95209424d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:24.736896 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b137fb2f-2e09-48ed-bb0c-70e95209424d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1314 microversion: 2.1 time: 0.334476 Aug 05 20:07:24.747170 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 232/456] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:24 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:24.762015 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-d1316b60-9199-48e9-a1f1-5f8ff07884f1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:24.765489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-d1316b60-9199-48e9-a1f1-5f8ff07884f1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:24.772703 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d1316b60-9199-48e9-a1f1-5f8ff07884f1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:24.773282 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d1316b60-9199-48e9-a1f1-5f8ff07884f1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:24.773949 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d1316b60-9199-48e9-a1f1-5f8ff07884f1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:24.774737 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d1316b60-9199-48e9-a1f1-5f8ff07884f1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:24.778786 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d1316b60-9199-48e9-a1f1-5f8ff07884f1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:24.779302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d1316b60-9199-48e9-a1f1-5f8ff07884f1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:24.813904 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-bc35e3fc-8f4f-49ef-9aa4-f3a1a426a2ff tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:24.827682 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-bc35e3fc-8f4f-49ef-9aa4-f3a1a426a2ff tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1319 microversion: 2.1 time: 0.310171 Aug 05 20:07:24.828286 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 225/457] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:24 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:24.837190 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-e3dbcea2-0a2d-4b11-b7a3-c1e9189193e5 req-8fe71d6d-6b4c-4592-9dbf-9f47efee53fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daea58f2-4fe8-42e5-afdb-c0b8d47b963c", "name": "network-vif-plugged", "status": "completed", "tag": "dd4c2340-2e4a-4630-b9ee-b8953b613c7a"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:24.861641 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-e3dbcea2-0a2d-4b11-b7a3-c1e9189193e5 req-8fe71d6d-6b4c-4592-9dbf-9f47efee53fe service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:24.862377 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-e3dbcea2-0a2d-4b11-b7a3-c1e9189193e5 req-8fe71d6d-6b4c-4592-9dbf-9f47efee53fe service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:24.863376 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-e3dbcea2-0a2d-4b11-b7a3-c1e9189193e5 req-8fe71d6d-6b4c-4592-9dbf-9f47efee53fe service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:24.885697 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-e3dbcea2-0a2d-4b11-b7a3-c1e9189193e5 req-8fe71d6d-6b4c-4592-9dbf-9f47efee53fe service nova] Creating event network-vif-plugged:dd4c2340-2e4a-4630-b9ee-b8953b613c7a for instance daea58f2-4fe8-42e5-afdb-c0b8d47b963c on hv-cinder-85221 Aug 05 20:07:24.891716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-e3dbcea2-0a2d-4b11-b7a3-c1e9189193e5 req-8fe71d6d-6b4c-4592-9dbf-9f47efee53fe service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059698 Aug 05 20:07:24.893278 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 226/458] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:07:24.898981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-81fc5244-0319-4c67-891c-2f46c0650036 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:24.902698 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-81fc5244-0319-4c67-891c-2f46c0650036 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:24.916722 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-81fc5244-0319-4c67-891c-2f46c0650036 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:24.921644 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-81fc5244-0319-4c67-891c-2f46c0650036 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:24.922544 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-81fc5244-0319-4c67-891c-2f46c0650036 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:24.923948 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-81fc5244-0319-4c67-891c-2f46c0650036 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:24.924750 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-81fc5244-0319-4c67-891c-2f46c0650036 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:24.925625 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-81fc5244-0319-4c67-891c-2f46c0650036 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:25.002858 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-d1316b60-9199-48e9-a1f1-5f8ff07884f1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:25.010705 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-d1316b60-9199-48e9-a1f1-5f8ff07884f1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1258 microversion: 2.1 time: 0.260767 Aug 05 20:07:25.012090 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 233/459] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:24 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1258 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:25.405492 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-81fc5244-0319-4c67-891c-2f46c0650036 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "POST /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90/action" status: 200 len: 28643 microversion: 2.1 time: 0.510495 Aug 05 20:07:25.406292 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 227/460] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Aug 5 20:07:24 2022] POST /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90/action => generated 28643 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:07:25.759918 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4201aa33-a7b0-4771-b25a-5ff38ef3d8f6 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:25.760529 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-4201aa33-a7b0-4771-b25a-5ff38ef3d8f6 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:25.767931 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4201aa33-a7b0-4771-b25a-5ff38ef3d8f6 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:25.768746 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4201aa33-a7b0-4771-b25a-5ff38ef3d8f6 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:25.769267 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4201aa33-a7b0-4771-b25a-5ff38ef3d8f6 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:25.770160 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4201aa33-a7b0-4771-b25a-5ff38ef3d8f6 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:25.770686 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4201aa33-a7b0-4771-b25a-5ff38ef3d8f6 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:25.771192 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4201aa33-a7b0-4771-b25a-5ff38ef3d8f6 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:25.850050 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-38b70983-4c03-44f3-915b-e81ff3e876db tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:25.850849 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-38b70983-4c03-44f3-915b-e81ff3e876db tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:25.864889 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-38b70983-4c03-44f3-915b-e81ff3e876db tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:25.865382 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-38b70983-4c03-44f3-915b-e81ff3e876db tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:25.866044 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-38b70983-4c03-44f3-915b-e81ff3e876db tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:25.866762 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-38b70983-4c03-44f3-915b-e81ff3e876db tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:25.867227 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-38b70983-4c03-44f3-915b-e81ff3e876db tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:25.867657 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-38b70983-4c03-44f3-915b-e81ff3e876db tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:26.060864 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-4201aa33-a7b0-4771-b25a-5ff38ef3d8f6 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:26.080053 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-4201aa33-a7b0-4771-b25a-5ff38ef3d8f6 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1498 microversion: 2.1 time: 0.323845 Aug 05 20:07:26.080667 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 234/461] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:25 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1498 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:26.092335 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-135e7664-ff13-42b9-9959-a159cdc16352 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:26.092974 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-135e7664-ff13-42b9-9959-a159cdc16352 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:26.119347 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-135e7664-ff13-42b9-9959-a159cdc16352 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:26.119930 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-135e7664-ff13-42b9-9959-a159cdc16352 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:26.120329 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-135e7664-ff13-42b9-9959-a159cdc16352 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:26.122623 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-135e7664-ff13-42b9-9959-a159cdc16352 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:26.123252 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-135e7664-ff13-42b9-9959-a159cdc16352 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:26.123850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-135e7664-ff13-42b9-9959-a159cdc16352 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:26.134830 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-38b70983-4c03-44f3-915b-e81ff3e876db tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:26.169263 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-38b70983-4c03-44f3-915b-e81ff3e876db tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1319 microversion: 2.1 time: 0.323354 Aug 05 20:07:26.169850 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 228/462] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:25 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1319 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:26.468667 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-135e7664-ff13-42b9-9959-a159cdc16352 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:26.483998 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-135e7664-ff13-42b9-9959-a159cdc16352 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1258 microversion: 2.1 time: 0.398615 Aug 05 20:07:26.484609 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 235/463] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:26 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1258 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:26.906019 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-08952a43-1eae-4678-bc05-0b71ccb16d01 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:26.907161 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-08952a43-1eae-4678-bc05-0b71ccb16d01 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:26.921627 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-08952a43-1eae-4678-bc05-0b71ccb16d01 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:26.923268 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-08952a43-1eae-4678-bc05-0b71ccb16d01 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:26.923921 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-08952a43-1eae-4678-bc05-0b71ccb16d01 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:26.931270 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-08952a43-1eae-4678-bc05-0b71ccb16d01 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:26.932025 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-08952a43-1eae-4678-bc05-0b71ccb16d01 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:26.932683 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-08952a43-1eae-4678-bc05-0b71ccb16d01 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:26.981322 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-08952a43-1eae-4678-bc05-0b71ccb16d01 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Going to try to terminate instance {{(pid=118191) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:07:27.079129 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:27.178709 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-08952a43-1eae-4678-bc05-0b71ccb16d01 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 204 len: 0 microversion: 2.1 time: 0.278477 Aug 05 20:07:27.180292 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 229/464] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:07:26 2022] DELETE /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:07:27.190705 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ba03d028-361c-4d14-a60a-87191c7bf88a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:27.192027 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-ba03d028-361c-4d14-a60a-87191c7bf88a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:27.205610 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-4df53b24-5307-4cdf-8172-2109f3b971a5 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:27.220869 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ba03d028-361c-4d14-a60a-87191c7bf88a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:27.222223 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-4df53b24-5307-4cdf-8172-2109f3b971a5 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:27.222807 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ba03d028-361c-4d14-a60a-87191c7bf88a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:27.224240 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ba03d028-361c-4d14-a60a-87191c7bf88a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:27.227259 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ba03d028-361c-4d14-a60a-87191c7bf88a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:27.227878 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ba03d028-361c-4d14-a60a-87191c7bf88a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:27.231971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ba03d028-361c-4d14-a60a-87191c7bf88a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:27.240830 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4df53b24-5307-4cdf-8172-2109f3b971a5 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:27.246784 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4df53b24-5307-4cdf-8172-2109f3b971a5 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:27.249180 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4df53b24-5307-4cdf-8172-2109f3b971a5 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:27.249892 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4df53b24-5307-4cdf-8172-2109f3b971a5 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:27.250356 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4df53b24-5307-4cdf-8172-2109f3b971a5 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:27.250787 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4df53b24-5307-4cdf-8172-2109f3b971a5 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:27.549499 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-4df53b24-5307-4cdf-8172-2109f3b971a5 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:27.557796 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-4df53b24-5307-4cdf-8172-2109f3b971a5 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1319 microversion: 2.1 time: 0.359792 Aug 05 20:07:27.565765 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-ba03d028-361c-4d14-a60a-87191c7bf88a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:27.569760 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 230/465] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:27 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1319 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:27.575465 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-ba03d028-361c-4d14-a60a-87191c7bf88a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1504 microversion: 2.1 time: 0.390686 Aug 05 20:07:27.579076 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-b16dfa70-712b-4a0f-a57d-b300561df808 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:27.579899 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-b16dfa70-712b-4a0f-a57d-b300561df808 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:27.580909 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 236/466] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:27 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1504 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:27.602736 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b16dfa70-712b-4a0f-a57d-b300561df808 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:27.603645 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b16dfa70-712b-4a0f-a57d-b300561df808 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:27.605917 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b16dfa70-712b-4a0f-a57d-b300561df808 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:27.607219 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b16dfa70-712b-4a0f-a57d-b300561df808 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:27.607986 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b16dfa70-712b-4a0f-a57d-b300561df808 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:27.608660 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b16dfa70-712b-4a0f-a57d-b300561df808 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:27.774809 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-b16dfa70-712b-4a0f-a57d-b300561df808 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:27.784521 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-b16dfa70-712b-4a0f-a57d-b300561df808 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1258 microversion: 2.1 time: 0.212666 Aug 05 20:07:27.785364 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 231/467] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:27 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1258 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:28.583711 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-49443b4f-098d-4b98-a3b2-dedc9445771b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:28.584427 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-49443b4f-098d-4b98-a3b2-dedc9445771b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:28.592094 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-49443b4f-098d-4b98-a3b2-dedc9445771b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:28.592615 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-49443b4f-098d-4b98-a3b2-dedc9445771b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:28.593055 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-49443b4f-098d-4b98-a3b2-dedc9445771b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:28.593757 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-49443b4f-098d-4b98-a3b2-dedc9445771b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:28.598726 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-49443b4f-098d-4b98-a3b2-dedc9445771b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:28.599176 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-49443b4f-098d-4b98-a3b2-dedc9445771b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:28.602144 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-933a1753-b5e5-4e7c-b750-e1d5b587f2b2 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:28.602770 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-933a1753-b5e5-4e7c-b750-e1d5b587f2b2 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:28.612227 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-933a1753-b5e5-4e7c-b750-e1d5b587f2b2 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:28.612837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-933a1753-b5e5-4e7c-b750-e1d5b587f2b2 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:28.613282 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-933a1753-b5e5-4e7c-b750-e1d5b587f2b2 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:28.613982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-933a1753-b5e5-4e7c-b750-e1d5b587f2b2 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:28.614435 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-933a1753-b5e5-4e7c-b750-e1d5b587f2b2 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:28.614862 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-933a1753-b5e5-4e7c-b750-e1d5b587f2b2 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:28.857217 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-49443b4f-098d-4b98-a3b2-dedc9445771b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:28.867821 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-49443b4f-098d-4b98-a3b2-dedc9445771b tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1319 microversion: 2.1 time: 0.288085 Aug 05 20:07:28.868501 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-933a1753-b5e5-4e7c-b750-e1d5b587f2b2 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:28.877097 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-933a1753-b5e5-4e7c-b750-e1d5b587f2b2 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1504 microversion: 2.1 time: 0.279146 Aug 05 20:07:28.878201 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 232/468] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:28 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1504 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:28.883225 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-dd16777c-78cf-42d2-a307-ea36571507db tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:28.884255 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-dd16777c-78cf-42d2-a307-ea36571507db tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:28.891609 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 237/469] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:28 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:28.895142 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dd16777c-78cf-42d2-a307-ea36571507db tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:28.895830 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dd16777c-78cf-42d2-a307-ea36571507db tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:28.896547 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dd16777c-78cf-42d2-a307-ea36571507db tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:28.897425 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dd16777c-78cf-42d2-a307-ea36571507db tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:28.898054 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dd16777c-78cf-42d2-a307-ea36571507db tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:28.898644 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dd16777c-78cf-42d2-a307-ea36571507db tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:29.080363 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-dd16777c-78cf-42d2-a307-ea36571507db tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:29.089664 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-dd16777c-78cf-42d2-a307-ea36571507db tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1258 microversion: 2.1 time: 0.209277 Aug 05 20:07:29.091063 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 233/470] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:28 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1258 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:29.893499 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-2a84cbe7-5a85-414d-abf5-6918332dce3f tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:29.894126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-2a84cbe7-5a85-414d-abf5-6918332dce3f tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:29.896525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:29.906930 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-b060f594-540a-4f00-a884-f9075e1676e0 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:29.907537 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-b060f594-540a-4f00-a884-f9075e1676e0 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:29.912605 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2a84cbe7-5a85-414d-abf5-6918332dce3f tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:29.913100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2a84cbe7-5a85-414d-abf5-6918332dce3f tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:29.913534 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2a84cbe7-5a85-414d-abf5-6918332dce3f tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:29.914243 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2a84cbe7-5a85-414d-abf5-6918332dce3f tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:29.914694 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2a84cbe7-5a85-414d-abf5-6918332dce3f tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:29.915114 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2a84cbe7-5a85-414d-abf5-6918332dce3f tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:29.919420 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b060f594-540a-4f00-a884-f9075e1676e0 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:29.919929 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b060f594-540a-4f00-a884-f9075e1676e0 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:29.920364 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b060f594-540a-4f00-a884-f9075e1676e0 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:29.921084 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b060f594-540a-4f00-a884-f9075e1676e0 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:29.921535 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b060f594-540a-4f00-a884-f9075e1676e0 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:29.921957 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b060f594-540a-4f00-a884-f9075e1676e0 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:30.149324 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-b060f594-540a-4f00-a884-f9075e1676e0 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:30.159389 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-b060f594-540a-4f00-a884-f9075e1676e0 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1504 microversion: 2.1 time: 0.256611 Aug 05 20:07:30.160002 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 234/471] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:29 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1504 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:30.166421 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-24d7f201-1191-40bb-b21a-9bcc80715fd6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:30.167567 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-24d7f201-1191-40bb-b21a-9bcc80715fd6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:30.191712 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24d7f201-1191-40bb-b21a-9bcc80715fd6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:30.192417 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24d7f201-1191-40bb-b21a-9bcc80715fd6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:30.192902 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24d7f201-1191-40bb-b21a-9bcc80715fd6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:30.194111 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24d7f201-1191-40bb-b21a-9bcc80715fd6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:30.194584 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24d7f201-1191-40bb-b21a-9bcc80715fd6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:30.195073 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24d7f201-1191-40bb-b21a-9bcc80715fd6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:30.204946 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-2a84cbe7-5a85-414d-abf5-6918332dce3f tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:30.213081 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=100 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:30.222558 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-2a84cbe7-5a85-414d-abf5-6918332dce3f tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1319 microversion: 2.1 time: 0.333050 Aug 05 20:07:30.226338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 238/472] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:29 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:30.466656 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-24d7f201-1191-40bb-b21a-9bcc80715fd6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:30.474894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-24d7f201-1191-40bb-b21a-9bcc80715fd6 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1258 microversion: 2.1 time: 0.313845 Aug 05 20:07:30.491074 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 235/473] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:30 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1258 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:30.847176 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-007e5177-d102-4d89-bc81-6309c527abfb req-f7169363-491b-4ff2-859f-c68928f01f8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5559da3c-05e6-432d-960c-67c53284cc54", "name": "network-vif-plugged", "status": "completed", "tag": "5e5897da-174c-4054-8f66-ed7648322749"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:30.863773 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-007e5177-d102-4d89-bc81-6309c527abfb req-f7169363-491b-4ff2-859f-c68928f01f8e service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:30.864520 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-007e5177-d102-4d89-bc81-6309c527abfb req-f7169363-491b-4ff2-859f-c68928f01f8e service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:30.865131 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-007e5177-d102-4d89-bc81-6309c527abfb req-f7169363-491b-4ff2-859f-c68928f01f8e service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:30.881759 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-007e5177-d102-4d89-bc81-6309c527abfb req-f7169363-491b-4ff2-859f-c68928f01f8e service nova] Creating event network-vif-plugged:5e5897da-174c-4054-8f66-ed7648322749 for instance 5559da3c-05e6-432d-960c-67c53284cc54 on hv-cinder-85221 Aug 05 20:07:30.888045 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-007e5177-d102-4d89-bc81-6309c527abfb req-f7169363-491b-4ff2-859f-c68928f01f8e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065628 Aug 05 20:07:30.888920 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 239/474] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:07:31.020995 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-7163460a-eaf0-4351-a28d-f1efe3a348c6 req-b885b414-c25a-4ca5-8f9e-4d84fd0d81ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f2c1b3-9d76-45f2-9d9f-919523202c6f", "name": "network-vif-deleted", "tag": "ef712212-e417-4060-a1af-5f21ebb36e2b"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:31.036636 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-7163460a-eaf0-4351-a28d-f1efe3a348c6 req-b885b414-c25a-4ca5-8f9e-4d84fd0d81ee service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:31.037213 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-7163460a-eaf0-4351-a28d-f1efe3a348c6 req-b885b414-c25a-4ca5-8f9e-4d84fd0d81ee service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:31.037709 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-7163460a-eaf0-4351-a28d-f1efe3a348c6 req-b885b414-c25a-4ca5-8f9e-4d84fd0d81ee service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:31.050011 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-7163460a-eaf0-4351-a28d-f1efe3a348c6 req-b885b414-c25a-4ca5-8f9e-4d84fd0d81ee service nova] Creating event network-vif-deleted:ef712212-e417-4060-a1af-5f21ebb36e2b for instance c8f2c1b3-9d76-45f2-9d9f-919523202c6f on hv-cinder-85221 Aug 05 20:07:31.060869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-7163460a-eaf0-4351-a28d-f1efe3a348c6 req-b885b414-c25a-4ca5-8f9e-4d84fd0d81ee service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043408 Aug 05 20:07:31.061954 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 236/475] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:07:31.185456 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-d973d81c-0af6-44eb-ab74-04d1c2b6f52a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:31.186801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-d973d81c-0af6-44eb-ab74-04d1c2b6f52a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:31.201845 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d973d81c-0af6-44eb-ab74-04d1c2b6f52a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:31.206427 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d973d81c-0af6-44eb-ab74-04d1c2b6f52a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:31.207648 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d973d81c-0af6-44eb-ab74-04d1c2b6f52a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:31.209048 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d973d81c-0af6-44eb-ab74-04d1c2b6f52a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:31.210956 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d973d81c-0af6-44eb-ab74-04d1c2b6f52a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:31.213669 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d973d81c-0af6-44eb-ab74-04d1c2b6f52a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:31.255612 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3234125d-7c67-489c-b471-56bc013cdb12 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:31.256663 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-3234125d-7c67-489c-b471-56bc013cdb12 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:31.268406 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3234125d-7c67-489c-b471-56bc013cdb12 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:31.269178 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3234125d-7c67-489c-b471-56bc013cdb12 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:31.269759 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3234125d-7c67-489c-b471-56bc013cdb12 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:31.270814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3234125d-7c67-489c-b471-56bc013cdb12 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:31.274747 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3234125d-7c67-489c-b471-56bc013cdb12 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:31.275442 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3234125d-7c67-489c-b471-56bc013cdb12 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:31.328871 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-d973d81c-0af6-44eb-ab74-04d1c2b6f52a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:31.338173 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-d973d81c-0af6-44eb-ab74-04d1c2b6f52a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1299 microversion: 2.1 time: 0.157808 Aug 05 20:07:31.361455 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 240/476] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:31 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1299 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:31.535716 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-aeea3057-5c7c-4e08-8f70-c5bdfd964d8a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:31.536359 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-aeea3057-5c7c-4e08-8f70-c5bdfd964d8a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:31.574402 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-aeea3057-5c7c-4e08-8f70-c5bdfd964d8a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:31.574812 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-aeea3057-5c7c-4e08-8f70-c5bdfd964d8a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:31.575509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-aeea3057-5c7c-4e08-8f70-c5bdfd964d8a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:31.576403 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-aeea3057-5c7c-4e08-8f70-c5bdfd964d8a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:31.577047 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-aeea3057-5c7c-4e08-8f70-c5bdfd964d8a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:31.577641 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-aeea3057-5c7c-4e08-8f70-c5bdfd964d8a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:31.662921 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3234125d-7c67-489c-b471-56bc013cdb12 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:31.674466 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3234125d-7c67-489c-b471-56bc013cdb12 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1507 microversion: 2.1 time: 0.422579 Aug 05 20:07:31.675322 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 237/477] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:31 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1507 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:31.702260 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-b0eff81e-5a67-464a-9795-4b880d7301d1 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2463ad9-158e-4107-8071-4445e32aed6a", "device": "/dev/sdb"}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:31.710414 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-b0eff81e-5a67-464a-9795-4b880d7301d1 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:31.721257 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b0eff81e-5a67-464a-9795-4b880d7301d1 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:31.722878 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b0eff81e-5a67-464a-9795-4b880d7301d1 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:31.723345 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b0eff81e-5a67-464a-9795-4b880d7301d1 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:31.724170 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b0eff81e-5a67-464a-9795-4b880d7301d1 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:31.724741 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b0eff81e-5a67-464a-9795-4b880d7301d1 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:31.725471 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b0eff81e-5a67-464a-9795-4b880d7301d1 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:31.804944 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-aeea3057-5c7c-4e08-8f70-c5bdfd964d8a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:31.813604 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-aeea3057-5c7c-4e08-8f70-c5bdfd964d8a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1258 microversion: 2.1 time: 0.307494 Aug 05 20:07:31.829386 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 241/478] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:31 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1258 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:32.367131 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-97edd747-a7c9-42f5-9ec7-2f4373c703a3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:32.368532 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-97edd747-a7c9-42f5-9ec7-2f4373c703a3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:32.376080 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-97edd747-a7c9-42f5-9ec7-2f4373c703a3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:32.378479 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-97edd747-a7c9-42f5-9ec7-2f4373c703a3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:32.379101 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-97edd747-a7c9-42f5-9ec7-2f4373c703a3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:32.379985 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-97edd747-a7c9-42f5-9ec7-2f4373c703a3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:32.380611 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-97edd747-a7c9-42f5-9ec7-2f4373c703a3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:32.381203 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-97edd747-a7c9-42f5-9ec7-2f4373c703a3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:32.418311 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-97edd747-a7c9-42f5-9ec7-2f4373c703a3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:32.419053 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-97edd747-a7c9-42f5-9ec7-2f4373c703a3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:32.419645 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-97edd747-a7c9-42f5-9ec7-2f4373c703a3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:32.422198 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.objects.instance [None req-97edd747-a7c9-42f5-9ec7-2f4373c703a3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lazy-loading 'fault' on Instance uuid c8f2c1b3-9d76-45f2-9d9f-919523202c6f {{(pid=118192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:07:32.476061 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-97edd747-a7c9-42f5-9ec7-2f4373c703a3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:32.486866 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-97edd747-a7c9-42f5-9ec7-2f4373c703a3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 200 len: 1304 microversion: 2.1 time: 0.124270 Aug 05 20:07:32.488606 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 242/479] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:32 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 1304 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:32.725012 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-b0eff81e-5a67-464a-9795-4b880d7301d1 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "POST /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.027169 Aug 05 20:07:32.728750 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 238/480] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Aug 5 20:07:31 2022] POST /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c/os-volume_attachments => generated 194 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:07:32.837220 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-66933659-abfc-42df-bff0-6dd1a01ff9bf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:32.838091 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-66933659-abfc-42df-bff0-6dd1a01ff9bf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:32.844691 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-66933659-abfc-42df-bff0-6dd1a01ff9bf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:32.845853 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-66933659-abfc-42df-bff0-6dd1a01ff9bf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:32.846797 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-66933659-abfc-42df-bff0-6dd1a01ff9bf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:32.847734 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-66933659-abfc-42df-bff0-6dd1a01ff9bf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:32.848197 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-66933659-abfc-42df-bff0-6dd1a01ff9bf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:32.848642 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-66933659-abfc-42df-bff0-6dd1a01ff9bf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:33.002953 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-66933659-abfc-42df-bff0-6dd1a01ff9bf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:33.012033 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-66933659-abfc-42df-bff0-6dd1a01ff9bf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1258 microversion: 2.1 time: 0.178885 Aug 05 20:07:33.024599 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 243/481] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:32 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1258 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:33.521952 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-465903a5-4f6b-4d6e-b196-6fc8238ce3ff tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:33.522679 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-465903a5-4f6b-4d6e-b196-6fc8238ce3ff tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: c8f2c1b3-9d76-45f2-9d9f-919523202c6f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:33.529929 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-465903a5-4f6b-4d6e-b196-6fc8238ce3ff tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:33.530420 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-465903a5-4f6b-4d6e-b196-6fc8238ce3ff tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:33.530853 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-465903a5-4f6b-4d6e-b196-6fc8238ce3ff tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:33.531573 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-465903a5-4f6b-4d6e-b196-6fc8238ce3ff tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:33.532004 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-465903a5-4f6b-4d6e-b196-6fc8238ce3ff tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:33.532423 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-465903a5-4f6b-4d6e-b196-6fc8238ce3ff tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:33.549350 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-465903a5-4f6b-4d6e-b196-6fc8238ce3ff tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] HTTP exception thrown: Instance c8f2c1b3-9d76-45f2-9d9f-919523202c6f could not be found. Aug 05 20:07:33.551304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-465903a5-4f6b-4d6e-b196-6fc8238ce3ff tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Request method failure captured: Aug 05 20:07:33.551304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f HTTP/1.1 Aug 05 20:07:33.551304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:07:33.551304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:07:33.551304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:07:33.551304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:07:33.551304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:07:33.551304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:07:33.551304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:07:33.551304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:07:33.551304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XhZwomWtN8b8nUoSSZ4g55IeuK_f0V3UJIxi1gzdlhWdaIJMji0lOI_l1AhWuVOmVdxJH4Jjpn7iAE1RTHhisggfv17ZPyor7sHk14Ln5QYBPAC0kUCl62NkjVxDfNK2CZkr3Yp4eEewWdHCV6Ek7bel7YBcCpN9H_VK7PFdNrCNd8 Aug 05 20:07:33.551304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:07:33.551304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:07:33.551304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:07:33.551304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:07:33.551304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:07:33.551304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:07:33.551304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: 2fee7422708346709cc0524d685031b3 Aug 05 20:07:33.551304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-VolumesActionsTest-58740868 Aug 05 20:07:33.551304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:07:33.551304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:07:33.552812 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2fee7422708346709cc0524d685031b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2fee7422708346709cc0524d685031b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2fee7422708346709cc0524d685031b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2fee7422708346709cc0524d685031b3", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:07:33.552812 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-VolumesActionsTest-58740868 Aug 05 20:07:33.552812 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: 2fee7422708346709cc0524d685031b3 Aug 05 20:07:33.552812 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-VolumesActionsTest-58740868 Aug 05 20:07:33.552812 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-VolumesActionsTest-58740868-project Aug 05 20:07:33.552812 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:07:33.552812 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:07:33.552812 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: a0dbaac800624b85ab8c07a369cf0aff Aug 05 20:07:33.552812 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-VolumesActionsTest-58740868-project Aug 05 20:07:33.552812 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: > Aug 05 20:07:33.552812 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Instance c8f2c1b3-9d76-45f2-9d9f-919523202c6f could not be found. Aug 05 20:07:33.552812 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'id': 'c8f2c1b3-9d76-45f2-9d9f-919523202c6f'} Aug 05 20:07:33.553623 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:07:33.553623 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:07:33.553623 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:07:33.553623 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:07:33.553623 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:07:33.553623 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:07:33.553623 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:07:33.553623 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:07:33.553623 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:07:33.553623 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:07:33.553623 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8f2c1b3-9d76-45f2-9d9f-919523202c6f could not be found. Aug 05 20:07:33.553623 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:07:33.553623 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:07:33.553623 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:07:33.553623 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:07:33.553623 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:07:33.553623 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:07:33.553623 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:07:33.553623 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:07:33.553623 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:07:33.554878 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:07:33.554878 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:07:33.554878 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:07:33.554878 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:07:33.554878 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:07:33.554878 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:07:33.554878 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:07:33.554878 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8f2c1b3-9d76-45f2-9d9f-919523202c6f could not be found. Aug 05 20:07:33.554878 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:07:33.554878 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:07:33.554878 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:07:33.554878 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:07:33.554878 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:07:33.554878 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:07:33.554878 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:07:33.554878 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:07:33.554878 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8f2c1b3-9d76-45f2-9d9f-919523202c6f could not be found. Aug 05 20:07:33.554878 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:07:33.555988 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-465903a5-4f6b-4d6e-b196-6fc8238ce3ff tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Returning 404 to user: Instance c8f2c1b3-9d76-45f2-9d9f-919523202c6f could not be found. {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:07:33.555988 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-465903a5-4f6b-4d6e-b196-6fc8238ce3ff tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f" status: 404 len: 111 microversion: 2.1 time: 0.043972 Aug 05 20:07:33.555988 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 239/482] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:33 2022] GET /compute/v2.1/servers/c8f2c1b3-9d76-45f2-9d9f-919523202c6f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:07:33.685189 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a463e067-258d-4e2a-8a96-35378033e825 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1266125980", "imageRef": "c148255e-9574-4d10-b9bb-13c9411eda77", "flavorRef": "452", "networks": [{"uuid": "932aef3c-9338-45de-939c-0a4c2ca3bb73"}]}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:33.749961 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.network.neutron [None req-a463e067-258d-4e2a-8a96-35378033e825 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] validate_networks() for [('932aef3c-9338-45de-939c-0a4c2ca3bb73', None, None, None, None, None)] {{(pid=118192) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:07:34.036512 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-87fa885a-e2aa-4feb-83bd-3b5f5a8b04fa tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:34.037263 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-87fa885a-e2aa-4feb-83bd-3b5f5a8b04fa tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:34.044154 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-87fa885a-e2aa-4feb-83bd-3b5f5a8b04fa tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:34.045010 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-87fa885a-e2aa-4feb-83bd-3b5f5a8b04fa tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:34.045663 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-87fa885a-e2aa-4feb-83bd-3b5f5a8b04fa tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:34.046593 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-87fa885a-e2aa-4feb-83bd-3b5f5a8b04fa tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:34.047242 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-87fa885a-e2aa-4feb-83bd-3b5f5a8b04fa tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:34.047859 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-87fa885a-e2aa-4feb-83bd-3b5f5a8b04fa tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:34.236952 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-a463e067-258d-4e2a-8a96-35378033e825 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Flavor limits 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:07:34.237674 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-a463e067-258d-4e2a-8a96-35378033e825 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Image limits 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:07:34.238251 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-a463e067-258d-4e2a-8a96-35378033e825 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Flavor pref 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:07:34.238835 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-a463e067-258d-4e2a-8a96-35378033e825 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Image pref 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:07:34.239476 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-a463e067-258d-4e2a-8a96-35378033e825 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:07:34.253070 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a463e067-258d-4e2a-8a96-35378033e825 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:34.253841 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a463e067-258d-4e2a-8a96-35378033e825 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:34.254512 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a463e067-258d-4e2a-8a96-35378033e825 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:34.256482 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a463e067-258d-4e2a-8a96-35378033e825 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:34.257369 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a463e067-258d-4e2a-8a96-35378033e825 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:34.258005 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a463e067-258d-4e2a-8a96-35378033e825 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:34.279474 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-a463e067-258d-4e2a-8a96-35378033e825 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Getting quotas for project 2fee7422708346709cc0524d685031b3. Resources: {'cores', 'ram', 'instances'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:07:34.282429 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-87fa885a-e2aa-4feb-83bd-3b5f5a8b04fa tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:34.286913 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-a463e067-258d-4e2a-8a96-35378033e825 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Getting quotas for user a0dbaac800624b85ab8c07a369cf0aff and project 2fee7422708346709cc0524d685031b3. Resources: {'cores', 'ram', 'instances'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:07:34.291907 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-87fa885a-e2aa-4feb-83bd-3b5f5a8b04fa tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1258 microversion: 2.1 time: 0.260195 Aug 05 20:07:34.292949 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 240/483] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:34 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1258 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:34.301772 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a463e067-258d-4e2a-8a96-35378033e825 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Going to run 1 instances... {{(pid=118192) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:07:34.304135 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a463e067-258d-4e2a-8a96-35378033e825 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c148255e-9574-4d10-b9bb-13c9411eda77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:07:34.357676 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a463e067-258d-4e2a-8a96-35378033e825 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680444 Aug 05 20:07:34.358509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 244/484] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Aug 5 20:07:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:07:34.370798 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-694ec30b-d18a-4d3c-8fc1-a4e3d3fc77a5 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:34.371835 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-694ec30b-d18a-4d3c-8fc1-a4e3d3fc77a5 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:34.446505 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-694ec30b-d18a-4d3c-8fc1-a4e3d3fc77a5 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:34.456955 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-694ec30b-d18a-4d3c-8fc1-a4e3d3fc77a5 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1214 microversion: 2.1 time: 0.091559 Aug 05 20:07:34.471274 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 241/485] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:34 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:35.322392 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-0896ac7d-9bb1-4062-a5ab-7e27a2da8455 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:35.323119 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-0896ac7d-9bb1-4062-a5ab-7e27a2da8455 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:35.335497 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0896ac7d-9bb1-4062-a5ab-7e27a2da8455 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:35.337860 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0896ac7d-9bb1-4062-a5ab-7e27a2da8455 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:35.338914 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0896ac7d-9bb1-4062-a5ab-7e27a2da8455 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:35.340702 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0896ac7d-9bb1-4062-a5ab-7e27a2da8455 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:35.342126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0896ac7d-9bb1-4062-a5ab-7e27a2da8455 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:35.342976 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0896ac7d-9bb1-4062-a5ab-7e27a2da8455 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:35.478133 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-04cc2e7c-2be6-4924-b95f-1916fe5c8712 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:35.479909 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-04cc2e7c-2be6-4924-b95f-1916fe5c8712 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:35.492126 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-04cc2e7c-2be6-4924-b95f-1916fe5c8712 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:35.492851 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-04cc2e7c-2be6-4924-b95f-1916fe5c8712 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:35.493529 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-04cc2e7c-2be6-4924-b95f-1916fe5c8712 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:35.495722 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-04cc2e7c-2be6-4924-b95f-1916fe5c8712 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:35.496733 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-04cc2e7c-2be6-4924-b95f-1916fe5c8712 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:35.497535 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-04cc2e7c-2be6-4924-b95f-1916fe5c8712 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:35.568070 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-04cc2e7c-2be6-4924-b95f-1916fe5c8712 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:35.578186 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-04cc2e7c-2be6-4924-b95f-1916fe5c8712 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1266 microversion: 2.1 time: 0.102779 Aug 05 20:07:35.579472 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 242/486] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:35 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:35.789616 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-0896ac7d-9bb1-4062-a5ab-7e27a2da8455 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:35.804344 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-0896ac7d-9bb1-4062-a5ab-7e27a2da8455 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1442 microversion: 2.1 time: 0.488246 Aug 05 20:07:35.805093 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 245/487] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:35 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1442 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:35.830097 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-fb9dc480-5b51-4bc4-8e83-8955f824b161 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:35.830716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-fb9dc480-5b51-4bc4-8e83-8955f824b161 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:35.837378 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fb9dc480-5b51-4bc4-8e83-8955f824b161 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:35.845084 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fb9dc480-5b51-4bc4-8e83-8955f824b161 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:35.845934 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fb9dc480-5b51-4bc4-8e83-8955f824b161 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:35.846838 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fb9dc480-5b51-4bc4-8e83-8955f824b161 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:35.847311 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fb9dc480-5b51-4bc4-8e83-8955f824b161 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:35.847741 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fb9dc480-5b51-4bc4-8e83-8955f824b161 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:36.279019 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-fb9dc480-5b51-4bc4-8e83-8955f824b161 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:36.287481 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-fb9dc480-5b51-4bc4-8e83-8955f824b161 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1442 microversion: 2.1 time: 0.461213 Aug 05 20:07:36.300025 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 243/488] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:35 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1442 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:36.603318 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-98ec09eb-566f-4de4-833e-c9bb0f143b41 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:36.603931 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-98ec09eb-566f-4de4-833e-c9bb0f143b41 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:36.616550 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-98ec09eb-566f-4de4-833e-c9bb0f143b41 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:36.618371 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-98ec09eb-566f-4de4-833e-c9bb0f143b41 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:36.619530 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-98ec09eb-566f-4de4-833e-c9bb0f143b41 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:36.625053 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-98ec09eb-566f-4de4-833e-c9bb0f143b41 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:36.625950 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-98ec09eb-566f-4de4-833e-c9bb0f143b41 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:36.626669 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-98ec09eb-566f-4de4-833e-c9bb0f143b41 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:36.874166 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-98ec09eb-566f-4de4-833e-c9bb0f143b41 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:36.883411 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-98ec09eb-566f-4de4-833e-c9bb0f143b41 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1272 microversion: 2.1 time: 0.285043 Aug 05 20:07:36.896605 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 246/489] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:36 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1272 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:37.908815 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-10b9e8d5-89fd-42a6-8ca3-5a9e0a3e8e49 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:37.910079 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-10b9e8d5-89fd-42a6-8ca3-5a9e0a3e8e49 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:37.916524 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-10b9e8d5-89fd-42a6-8ca3-5a9e0a3e8e49 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:37.917444 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-10b9e8d5-89fd-42a6-8ca3-5a9e0a3e8e49 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:37.918331 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-10b9e8d5-89fd-42a6-8ca3-5a9e0a3e8e49 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:37.919249 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-10b9e8d5-89fd-42a6-8ca3-5a9e0a3e8e49 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:37.919874 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-10b9e8d5-89fd-42a6-8ca3-5a9e0a3e8e49 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:37.920467 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-10b9e8d5-89fd-42a6-8ca3-5a9e0a3e8e49 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:38.418717 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-10b9e8d5-89fd-42a6-8ca3-5a9e0a3e8e49 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:38.430753 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-10b9e8d5-89fd-42a6-8ca3-5a9e0a3e8e49 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.526047 Aug 05 20:07:38.443755 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 244/490] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:37 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:38.542230 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-976189e6-30b0-45d8-9cab-dacc3e53c85f req-19a0b9d8-4df7-4814-bc98-c8beaa9e0bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67d9e448-6ea5-4514-ac0a-9d7fcc2b590d", "tag": "987841ac-6b76-4047-8e5f-66073582dcc7"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:38.569648 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-976189e6-30b0-45d8-9cab-dacc3e53c85f req-19a0b9d8-4df7-4814-bc98-c8beaa9e0bf3 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:38.570409 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-976189e6-30b0-45d8-9cab-dacc3e53c85f req-19a0b9d8-4df7-4814-bc98-c8beaa9e0bf3 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:38.570957 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-976189e6-30b0-45d8-9cab-dacc3e53c85f req-19a0b9d8-4df7-4814-bc98-c8beaa9e0bf3 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:38.600217 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-976189e6-30b0-45d8-9cab-dacc3e53c85f req-19a0b9d8-4df7-4814-bc98-c8beaa9e0bf3 service nova] Creating event network-changed:987841ac-6b76-4047-8e5f-66073582dcc7 for instance 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d on hv-cinder-85221 Aug 05 20:07:38.612624 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-976189e6-30b0-45d8-9cab-dacc3e53c85f req-19a0b9d8-4df7-4814-bc98-c8beaa9e0bf3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076737 Aug 05 20:07:38.616469 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 247/491] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:07:39.126937 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-a755a406-375c-4ee4-a6cb-4068e0d99145 req-9983b4f5-0213-4904-b79b-1525b9b819d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5559da3c-05e6-432d-960c-67c53284cc54", "tag": "5e5897da-174c-4054-8f66-ed7648322749"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:39.141093 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-a755a406-375c-4ee4-a6cb-4068e0d99145 req-9983b4f5-0213-4904-b79b-1525b9b819d9 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:39.141875 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-a755a406-375c-4ee4-a6cb-4068e0d99145 req-9983b4f5-0213-4904-b79b-1525b9b819d9 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:39.142519 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-a755a406-375c-4ee4-a6cb-4068e0d99145 req-9983b4f5-0213-4904-b79b-1525b9b819d9 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:39.163242 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-a755a406-375c-4ee4-a6cb-4068e0d99145 req-9983b4f5-0213-4904-b79b-1525b9b819d9 service nova] Creating event network-changed:5e5897da-174c-4054-8f66-ed7648322749 for instance 5559da3c-05e6-432d-960c-67c53284cc54 on hv-cinder-85221 Aug 05 20:07:39.172491 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-a755a406-375c-4ee4-a6cb-4068e0d99145 req-9983b4f5-0213-4904-b79b-1525b9b819d9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049640 Aug 05 20:07:39.178645 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 245/492] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:07:39.455677 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-7c04d278-3533-4270-aa47-b3f39f8833df tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:39.456702 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-7c04d278-3533-4270-aa47-b3f39f8833df tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:39.463228 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7c04d278-3533-4270-aa47-b3f39f8833df tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:39.464878 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7c04d278-3533-4270-aa47-b3f39f8833df tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:39.465499 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7c04d278-3533-4270-aa47-b3f39f8833df tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:39.466380 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7c04d278-3533-4270-aa47-b3f39f8833df tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:39.466999 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7c04d278-3533-4270-aa47-b3f39f8833df tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:39.467419 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7c04d278-3533-4270-aa47-b3f39f8833df tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:39.645152 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-7c04d278-3533-4270-aa47-b3f39f8833df tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:39.655152 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-7c04d278-3533-4270-aa47-b3f39f8833df tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.203988 Aug 05 20:07:39.655738 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 248/493] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:39 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:40.678732 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-525638cb-acfb-40a2-8d87-9e4bf1c4791c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:40.680191 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-525638cb-acfb-40a2-8d87-9e4bf1c4791c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:40.686831 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-525638cb-acfb-40a2-8d87-9e4bf1c4791c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:40.687556 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-525638cb-acfb-40a2-8d87-9e4bf1c4791c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:40.688196 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-525638cb-acfb-40a2-8d87-9e4bf1c4791c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:40.689097 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-525638cb-acfb-40a2-8d87-9e4bf1c4791c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:40.689718 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-525638cb-acfb-40a2-8d87-9e4bf1c4791c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:40.690150 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-525638cb-acfb-40a2-8d87-9e4bf1c4791c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:40.853696 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-525638cb-acfb-40a2-8d87-9e4bf1c4791c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:40.862603 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-525638cb-acfb-40a2-8d87-9e4bf1c4791c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.188913 Aug 05 20:07:40.863198 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 246/494] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:40 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:41.597545 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-641d19d2-1f93-4e69-bcb8-00a301592fa1 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Action: 'create', calling method: .version_select at 0x7fe3e458d160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-205380879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdscE30FlV2YycIW7IfMokPWFLgUyouxWiqA+zDHWVuTgRkF2vfgl2NCeTNBc+y6jv2xIU0p8Unpz9P+XZG39OdOXyb6RMWep6E7dpqTKlpJ+AMvOK2fukhFandYUiWLg=="}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:41.613652 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-641d19d2-1f93-4e69-bcb8-00a301592fa1 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Getting quotas for project fe26e033d1844e28849ed4de857a7958. Resources: {'key_pairs'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:07:41.617685 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-641d19d2-1f93-4e69-bcb8-00a301592fa1 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Getting quotas for user 368838695ea74570b7e30c17a211b82b and project fe26e033d1844e28849ed4de857a7958. Resources: {'key_pairs'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:07:41.640033 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-641d19d2-1f93-4e69-bcb8-00a301592fa1 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.046388 Aug 05 20:07:41.640624 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 249/495] 10.222.0.39 () {60 vars in 1159 bytes} [Fri Aug 5 20:07:41 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:07:41.691505 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9dcade93-8077-4b97-8a51-38129d7e5845 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2114335646", "imageRef": "d8988d37-32e3-4a53-b6bc-faeff340e35d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-205380879", "networks": [{"uuid": "24836e5e-689a-4e34-a979-0f8f355d5255"}]}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:41.744216 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.network.neutron [None req-9dcade93-8077-4b97-8a51-38129d7e5845 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] validate_networks() for [('24836e5e-689a-4e34-a979-0f8f355d5255', None, None, None, None, None)] {{(pid=118191) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:07:41.883021 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-5cc8db9a-2166-4059-90d9-eea4555524b8 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:41.883661 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-5cc8db9a-2166-4059-90d9-eea4555524b8 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:41.890598 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5cc8db9a-2166-4059-90d9-eea4555524b8 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:41.891088 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5cc8db9a-2166-4059-90d9-eea4555524b8 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:41.891524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5cc8db9a-2166-4059-90d9-eea4555524b8 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:41.892228 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5cc8db9a-2166-4059-90d9-eea4555524b8 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:41.892713 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5cc8db9a-2166-4059-90d9-eea4555524b8 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:41.893198 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5cc8db9a-2166-4059-90d9-eea4555524b8 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:42.102703 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-5cc8db9a-2166-4059-90d9-eea4555524b8 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:42.111023 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-5cc8db9a-2166-4059-90d9-eea4555524b8 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.231800 Aug 05 20:07:42.111781 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 250/496] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:41 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:42.185626 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-9dcade93-8077-4b97-8a51-38129d7e5845 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Flavor limits 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:07:42.186045 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-9dcade93-8077-4b97-8a51-38129d7e5845 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Image limits 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:07:42.186582 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-9dcade93-8077-4b97-8a51-38129d7e5845 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Flavor pref 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:07:42.186999 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-9dcade93-8077-4b97-8a51-38129d7e5845 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Image pref 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:07:42.187405 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-9dcade93-8077-4b97-8a51-38129d7e5845 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:07:42.195899 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9dcade93-8077-4b97-8a51-38129d7e5845 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:42.196375 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9dcade93-8077-4b97-8a51-38129d7e5845 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:42.196836 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9dcade93-8077-4b97-8a51-38129d7e5845 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:42.197550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9dcade93-8077-4b97-8a51-38129d7e5845 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:42.197998 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9dcade93-8077-4b97-8a51-38129d7e5845 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:42.198412 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9dcade93-8077-4b97-8a51-38129d7e5845 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:42.215137 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-9dcade93-8077-4b97-8a51-38129d7e5845 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Getting quotas for project fe26e033d1844e28849ed4de857a7958. Resources: {'cores', 'ram', 'instances'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:07:42.219369 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-9dcade93-8077-4b97-8a51-38129d7e5845 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Getting quotas for user 368838695ea74570b7e30c17a211b82b and project fe26e033d1844e28849ed4de857a7958. Resources: {'cores', 'ram', 'instances'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:07:42.230880 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-9dcade93-8077-4b97-8a51-38129d7e5845 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Going to run 1 instances... {{(pid=118191) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:07:42.233113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-9dcade93-8077-4b97-8a51-38129d7e5845 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d8988d37-32e3-4a53-b6bc-faeff340e35d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118191) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:07:42.278592 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-9dcade93-8077-4b97-8a51-38129d7e5845 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590858 Aug 05 20:07:42.279229 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 247/497] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Aug 5 20:07:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:07:42.290173 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-7cd6c298-05bc-4dcd-8ff3-6966ea6c50af tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:42.290875 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-7cd6c298-05bc-4dcd-8ff3-6966ea6c50af tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:42.346932 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-7cd6c298-05bc-4dcd-8ff3-6966ea6c50af tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:42.353674 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-7cd6c298-05bc-4dcd-8ff3-6966ea6c50af tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1258 microversion: 2.1 time: 0.067347 Aug 05 20:07:42.354877 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 251/498] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:42 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:43.134147 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3838f86f-bb81-4b76-984e-81b11b809258 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:43.134766 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-3838f86f-bb81-4b76-984e-81b11b809258 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:43.142008 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3838f86f-bb81-4b76-984e-81b11b809258 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:43.142508 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3838f86f-bb81-4b76-984e-81b11b809258 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:43.142948 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3838f86f-bb81-4b76-984e-81b11b809258 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:43.143654 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3838f86f-bb81-4b76-984e-81b11b809258 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:43.144112 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3838f86f-bb81-4b76-984e-81b11b809258 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:43.144540 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3838f86f-bb81-4b76-984e-81b11b809258 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:43.167167 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:43.293598 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3838f86f-bb81-4b76-984e-81b11b809258 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:43.301141 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3838f86f-bb81-4b76-984e-81b11b809258 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.171913 Aug 05 20:07:43.301701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 248/499] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:43 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:43.374396 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-7a72baaf-f892-4070-a0db-0859007d4ee2 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:43.375000 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-7a72baaf-f892-4070-a0db-0859007d4ee2 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:43.381298 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7a72baaf-f892-4070-a0db-0859007d4ee2 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:43.381779 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7a72baaf-f892-4070-a0db-0859007d4ee2 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:43.382209 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7a72baaf-f892-4070-a0db-0859007d4ee2 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:43.382893 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7a72baaf-f892-4070-a0db-0859007d4ee2 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:43.383345 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7a72baaf-f892-4070-a0db-0859007d4ee2 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:43.383763 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7a72baaf-f892-4070-a0db-0859007d4ee2 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:43.443643 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-7a72baaf-f892-4070-a0db-0859007d4ee2 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:43.451707 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-7a72baaf-f892-4070-a0db-0859007d4ee2 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1254 microversion: 2.1 time: 0.081153 Aug 05 20:07:43.452259 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 252/500] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:43 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1254 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:44.322335 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f1c96be8-5aa7-4732-95bc-1c3d3a252403 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:44.322980 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f1c96be8-5aa7-4732-95bc-1c3d3a252403 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:44.329724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f1c96be8-5aa7-4732-95bc-1c3d3a252403 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:44.330212 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f1c96be8-5aa7-4732-95bc-1c3d3a252403 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:44.330644 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f1c96be8-5aa7-4732-95bc-1c3d3a252403 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:44.331335 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f1c96be8-5aa7-4732-95bc-1c3d3a252403 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:44.331788 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f1c96be8-5aa7-4732-95bc-1c3d3a252403 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:44.332213 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f1c96be8-5aa7-4732-95bc-1c3d3a252403 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:44.465164 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f1c96be8-5aa7-4732-95bc-1c3d3a252403 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:44.471737 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-5f81dba3-3eeb-4206-9cf9-a0146e83518a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:44.472357 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-5f81dba3-3eeb-4206-9cf9-a0146e83518a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:44.472732 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f1c96be8-5aa7-4732-95bc-1c3d3a252403 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.154393 Aug 05 20:07:44.473312 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 249/501] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:44 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:44.474359 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell0:SELECT=2 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:44.481247 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5f81dba3-3eeb-4206-9cf9-a0146e83518a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:44.481739 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5f81dba3-3eeb-4206-9cf9-a0146e83518a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:44.482183 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5f81dba3-3eeb-4206-9cf9-a0146e83518a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:44.482888 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5f81dba3-3eeb-4206-9cf9-a0146e83518a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:44.483345 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5f81dba3-3eeb-4206-9cf9-a0146e83518a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:44.483777 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5f81dba3-3eeb-4206-9cf9-a0146e83518a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:44.547137 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-5f81dba3-3eeb-4206-9cf9-a0146e83518a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:44.554606 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-5f81dba3-3eeb-4206-9cf9-a0146e83518a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1310 microversion: 2.1 time: 0.086656 Aug 05 20:07:44.555286 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 253/502] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:44 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:45.500959 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-cfc869d0-48b0-4eb9-b1b2-f6aa2e0f7077 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:45.501770 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-cfc869d0-48b0-4eb9-b1b2-f6aa2e0f7077 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:45.510720 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cfc869d0-48b0-4eb9-b1b2-f6aa2e0f7077 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:45.511723 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cfc869d0-48b0-4eb9-b1b2-f6aa2e0f7077 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:45.512178 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cfc869d0-48b0-4eb9-b1b2-f6aa2e0f7077 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:45.513220 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cfc869d0-48b0-4eb9-b1b2-f6aa2e0f7077 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:45.513873 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cfc869d0-48b0-4eb9-b1b2-f6aa2e0f7077 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:45.514683 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cfc869d0-48b0-4eb9-b1b2-f6aa2e0f7077 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:45.578895 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ccdf2832-6e2d-43d5-a294-e81bc486982a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:45.580955 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-ccdf2832-6e2d-43d5-a294-e81bc486982a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:45.592489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ccdf2832-6e2d-43d5-a294-e81bc486982a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:45.593479 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ccdf2832-6e2d-43d5-a294-e81bc486982a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:45.594481 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ccdf2832-6e2d-43d5-a294-e81bc486982a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:45.595996 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ccdf2832-6e2d-43d5-a294-e81bc486982a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:45.597005 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ccdf2832-6e2d-43d5-a294-e81bc486982a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:45.598034 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ccdf2832-6e2d-43d5-a294-e81bc486982a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:45.837521 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-cfc869d0-48b0-4eb9-b1b2-f6aa2e0f7077 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:45.862369 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-cfc869d0-48b0-4eb9-b1b2-f6aa2e0f7077 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.370435 Aug 05 20:07:45.864177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 250/503] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:45 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:45.911670 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-ccdf2832-6e2d-43d5-a294-e81bc486982a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:45.920759 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-ccdf2832-6e2d-43d5-a294-e81bc486982a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.348533 Aug 05 20:07:45.921940 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 254/504] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:45 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:46.885184 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-96dd7d89-a9c3-4178-8cad-7174f8d8ac6b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:46.885854 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-96dd7d89-a9c3-4178-8cad-7174f8d8ac6b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:46.892469 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-96dd7d89-a9c3-4178-8cad-7174f8d8ac6b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:46.892991 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-96dd7d89-a9c3-4178-8cad-7174f8d8ac6b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:46.893445 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-96dd7d89-a9c3-4178-8cad-7174f8d8ac6b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:46.894120 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-96dd7d89-a9c3-4178-8cad-7174f8d8ac6b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:46.894575 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-96dd7d89-a9c3-4178-8cad-7174f8d8ac6b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:46.895000 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-96dd7d89-a9c3-4178-8cad-7174f8d8ac6b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:46.945493 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-9c1e2fa9-29a7-4237-a600-2f87131b5fdd tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:46.946139 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-9c1e2fa9-29a7-4237-a600-2f87131b5fdd tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:46.952770 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9c1e2fa9-29a7-4237-a600-2f87131b5fdd tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:46.953263 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9c1e2fa9-29a7-4237-a600-2f87131b5fdd tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:46.953702 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9c1e2fa9-29a7-4237-a600-2f87131b5fdd tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:46.954671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9c1e2fa9-29a7-4237-a600-2f87131b5fdd tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:46.955130 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9c1e2fa9-29a7-4237-a600-2f87131b5fdd tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:46.955564 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9c1e2fa9-29a7-4237-a600-2f87131b5fdd tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:47.074398 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-96dd7d89-a9c3-4178-8cad-7174f8d8ac6b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:47.083118 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-96dd7d89-a9c3-4178-8cad-7174f8d8ac6b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.201902 Aug 05 20:07:47.093108 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 251/505] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:46 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:47.123274 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-9c1e2fa9-29a7-4237-a600-2f87131b5fdd tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:47.130839 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-9c1e2fa9-29a7-4237-a600-2f87131b5fdd tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.189565 Aug 05 20:07:47.131423 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 255/506] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:46 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:48.104459 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-2478790b-513f-4d20-9f27-e49732ffa9a4 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:48.105092 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-2478790b-513f-4d20-9f27-e49732ffa9a4 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:48.111594 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2478790b-513f-4d20-9f27-e49732ffa9a4 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:48.112313 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2478790b-513f-4d20-9f27-e49732ffa9a4 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:48.112933 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2478790b-513f-4d20-9f27-e49732ffa9a4 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:48.113782 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2478790b-513f-4d20-9f27-e49732ffa9a4 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:48.114462 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2478790b-513f-4d20-9f27-e49732ffa9a4 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:48.115234 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2478790b-513f-4d20-9f27-e49732ffa9a4 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:48.152034 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-fbc23594-edec-4d44-ab5d-1ebb1997b4ea tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:48.152684 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-fbc23594-edec-4d44-ab5d-1ebb1997b4ea tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:48.159328 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fbc23594-edec-4d44-ab5d-1ebb1997b4ea tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:48.159825 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fbc23594-edec-4d44-ab5d-1ebb1997b4ea tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:48.160263 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fbc23594-edec-4d44-ab5d-1ebb1997b4ea tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:48.161177 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fbc23594-edec-4d44-ab5d-1ebb1997b4ea tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:48.161788 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fbc23594-edec-4d44-ab5d-1ebb1997b4ea tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:48.162380 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fbc23594-edec-4d44-ab5d-1ebb1997b4ea tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:48.328976 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-2478790b-513f-4d20-9f27-e49732ffa9a4 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:48.336598 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-2478790b-513f-4d20-9f27-e49732ffa9a4 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.236043 Aug 05 20:07:48.337273 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 252/507] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:48 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:48.349999 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-fbc23594-edec-4d44-ab5d-1ebb1997b4ea tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:48.357763 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-fbc23594-edec-4d44-ab5d-1ebb1997b4ea tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.210375 Aug 05 20:07:48.358327 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 256/508] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:48 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:48.451167 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-85eb68d3-3093-46c7-98cf-796c8b3f2316 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:48.451670 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-85eb68d3-3093-46c7-98cf-796c8b3f2316 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:48.457572 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-85eb68d3-3093-46c7-98cf-796c8b3f2316 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:48.458054 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-85eb68d3-3093-46c7-98cf-796c8b3f2316 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:48.458487 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-85eb68d3-3093-46c7-98cf-796c8b3f2316 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:48.459170 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-85eb68d3-3093-46c7-98cf-796c8b3f2316 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:48.459623 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-85eb68d3-3093-46c7-98cf-796c8b3f2316 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:48.460047 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-85eb68d3-3093-46c7-98cf-796c8b3f2316 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:48.484024 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-85eb68d3-3093-46c7-98cf-796c8b3f2316 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90/ips" status: 200 len: 150 microversion: 2.1 time: 0.145574 Aug 05 20:07:48.484604 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 253/509] 10.222.0.39 () {58 vars in 1248 bytes} [Fri Aug 5 20:07:48 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90/ips => generated 150 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:07:49.358423 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a4ca5a6b-3a1b-4a80-9d77-309a76ea75de tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:49.358985 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a4ca5a6b-3a1b-4a80-9d77-309a76ea75de tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:49.365363 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a4ca5a6b-3a1b-4a80-9d77-309a76ea75de tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:49.365886 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a4ca5a6b-3a1b-4a80-9d77-309a76ea75de tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:49.366328 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a4ca5a6b-3a1b-4a80-9d77-309a76ea75de tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:49.367016 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a4ca5a6b-3a1b-4a80-9d77-309a76ea75de tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:49.367499 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a4ca5a6b-3a1b-4a80-9d77-309a76ea75de tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:49.367929 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a4ca5a6b-3a1b-4a80-9d77-309a76ea75de tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:49.377381 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-8796127a-b5a0-4c10-a0ed-f3179fa52c55 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:49.378001 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-8796127a-b5a0-4c10-a0ed-f3179fa52c55 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:49.384416 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8796127a-b5a0-4c10-a0ed-f3179fa52c55 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:49.385565 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8796127a-b5a0-4c10-a0ed-f3179fa52c55 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:49.386012 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8796127a-b5a0-4c10-a0ed-f3179fa52c55 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:49.386714 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8796127a-b5a0-4c10-a0ed-f3179fa52c55 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:49.387172 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8796127a-b5a0-4c10-a0ed-f3179fa52c55 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:49.387600 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8796127a-b5a0-4c10-a0ed-f3179fa52c55 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:49.568775 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a4ca5a6b-3a1b-4a80-9d77-309a76ea75de tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:49.573319 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8796127a-b5a0-4c10-a0ed-f3179fa52c55 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:49.576690 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a4ca5a6b-3a1b-4a80-9d77-309a76ea75de tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.222211 Aug 05 20:07:49.577265 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 257/510] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:49 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:49.580867 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-8796127a-b5a0-4c10-a0ed-f3179fa52c55 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.207222 Aug 05 20:07:49.581426 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 254/511] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:49 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:50.598970 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-54c9a111-ba72-4327-bf70-875c347d4494 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:50.600439 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-54c9a111-ba72-4327-bf70-875c347d4494 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:50.601592 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7b0725da-03cb-42b1-9bff-2b965498d0a5 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:50.602459 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-7b0725da-03cb-42b1-9bff-2b965498d0a5 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:50.608525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-54c9a111-ba72-4327-bf70-875c347d4494 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:50.609043 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-54c9a111-ba72-4327-bf70-875c347d4494 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:50.609479 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-54c9a111-ba72-4327-bf70-875c347d4494 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:50.610183 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-54c9a111-ba72-4327-bf70-875c347d4494 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:50.610563 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7b0725da-03cb-42b1-9bff-2b965498d0a5 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:50.610721 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-54c9a111-ba72-4327-bf70-875c347d4494 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:50.611047 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-54c9a111-ba72-4327-bf70-875c347d4494 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:50.611155 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7b0725da-03cb-42b1-9bff-2b965498d0a5 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:50.611476 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7b0725da-03cb-42b1-9bff-2b965498d0a5 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:50.612168 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7b0725da-03cb-42b1-9bff-2b965498d0a5 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:50.612642 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7b0725da-03cb-42b1-9bff-2b965498d0a5 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:50.613064 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7b0725da-03cb-42b1-9bff-2b965498d0a5 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:50.825008 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-7b0725da-03cb-42b1-9bff-2b965498d0a5 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:50.834685 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-54c9a111-ba72-4327-bf70-875c347d4494 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:50.843973 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-54c9a111-ba72-4327-bf70-875c347d4494 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.249281 Aug 05 20:07:50.844775 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 258/512] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:50 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:50.845917 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-7b0725da-03cb-42b1-9bff-2b965498d0a5 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.248641 Aug 05 20:07:50.846618 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 255/513] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:50 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:51.864833 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-94675654-3c88-41fd-8ede-07fb6cf0f832 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:51.865450 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-94675654-3c88-41fd-8ede-07fb6cf0f832 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:51.866351 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-19109cd1-d500-436a-8475-146245867ce7 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:51.866965 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-19109cd1-d500-436a-8475-146245867ce7 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:51.872509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-94675654-3c88-41fd-8ede-07fb6cf0f832 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:51.873037 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-94675654-3c88-41fd-8ede-07fb6cf0f832 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:51.873482 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-94675654-3c88-41fd-8ede-07fb6cf0f832 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:51.873935 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-19109cd1-d500-436a-8475-146245867ce7 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:51.874204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-94675654-3c88-41fd-8ede-07fb6cf0f832 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:51.874413 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-19109cd1-d500-436a-8475-146245867ce7 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:51.874662 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-94675654-3c88-41fd-8ede-07fb6cf0f832 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:51.874840 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-19109cd1-d500-436a-8475-146245867ce7 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:51.875095 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-94675654-3c88-41fd-8ede-07fb6cf0f832 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:51.875519 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-19109cd1-d500-436a-8475-146245867ce7 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:51.875966 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-19109cd1-d500-436a-8475-146245867ce7 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:51.876385 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-19109cd1-d500-436a-8475-146245867ce7 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:51.879170 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=100 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:52.078518 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-19109cd1-d500-436a-8475-146245867ce7 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:52.086636 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-94675654-3c88-41fd-8ede-07fb6cf0f832 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:52.086920 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-19109cd1-d500-436a-8475-146245867ce7 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.224375 Aug 05 20:07:52.088557 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 256/514] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:51 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:52.096076 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-94675654-3c88-41fd-8ede-07fb6cf0f832 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.235212 Aug 05 20:07:52.096958 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 259/515] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:51 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:53.117823 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-4edc94c3-c824-4a42-9a3f-d665e2a4559b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:53.118444 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-4edc94c3-c824-4a42-9a3f-d665e2a4559b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:53.120270 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=2 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:53.120924 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-19392a95-e8f2-4612-bb28-dbc8a22bb2d2 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:53.121556 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=8 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:53.121764 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-19392a95-e8f2-4612-bb28-dbc8a22bb2d2 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:53.124929 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell0:SELECT=12 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:53.127544 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4edc94c3-c824-4a42-9a3f-d665e2a4559b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:53.128357 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4edc94c3-c824-4a42-9a3f-d665e2a4559b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:53.129784 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4edc94c3-c824-4a42-9a3f-d665e2a4559b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:53.130345 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-19392a95-e8f2-4612-bb28-dbc8a22bb2d2 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:53.130826 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-19392a95-e8f2-4612-bb28-dbc8a22bb2d2 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:53.131056 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4edc94c3-c824-4a42-9a3f-d665e2a4559b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:53.131265 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-19392a95-e8f2-4612-bb28-dbc8a22bb2d2 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:53.131906 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4edc94c3-c824-4a42-9a3f-d665e2a4559b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:53.132029 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-19392a95-e8f2-4612-bb28-dbc8a22bb2d2 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:53.132489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-19392a95-e8f2-4612-bb28-dbc8a22bb2d2 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:53.132991 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4edc94c3-c824-4a42-9a3f-d665e2a4559b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:53.133105 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-19392a95-e8f2-4612-bb28-dbc8a22bb2d2 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:53.351096 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-4edc94c3-c824-4a42-9a3f-d665e2a4559b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:53.359369 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-4edc94c3-c824-4a42-9a3f-d665e2a4559b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.245403 Aug 05 20:07:53.359635 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-19392a95-e8f2-4612-bb28-dbc8a22bb2d2 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:53.360332 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 257/516] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:53 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:53.367127 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-19392a95-e8f2-4612-bb28-dbc8a22bb2d2 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.250035 Aug 05 20:07:53.367990 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 260/517] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:53 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:54.383343 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-85a71ab3-1c82-4f50-a011-adc4a3581ba5 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:54.383952 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-85a71ab3-1c82-4f50-a011-adc4a3581ba5 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:54.387423 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4c6c4ea8-1fac-432b-a7a0-b8b421c35c92 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:54.393337 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-4c6c4ea8-1fac-432b-a7a0-b8b421c35c92 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:54.395496 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4c6c4ea8-1fac-432b-a7a0-b8b421c35c92 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:54.396243 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4c6c4ea8-1fac-432b-a7a0-b8b421c35c92 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:54.396869 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4c6c4ea8-1fac-432b-a7a0-b8b421c35c92 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:54.397758 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4c6c4ea8-1fac-432b-a7a0-b8b421c35c92 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:54.398390 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4c6c4ea8-1fac-432b-a7a0-b8b421c35c92 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:54.399159 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4c6c4ea8-1fac-432b-a7a0-b8b421c35c92 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:54.406749 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-85a71ab3-1c82-4f50-a011-adc4a3581ba5 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:54.407271 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-85a71ab3-1c82-4f50-a011-adc4a3581ba5 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:54.407775 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-85a71ab3-1c82-4f50-a011-adc4a3581ba5 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:54.408683 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-85a71ab3-1c82-4f50-a011-adc4a3581ba5 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:54.409140 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-85a71ab3-1c82-4f50-a011-adc4a3581ba5 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:54.409562 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-85a71ab3-1c82-4f50-a011-adc4a3581ba5 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:54.616932 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-4c6c4ea8-1fac-432b-a7a0-b8b421c35c92 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:54.620287 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-85a71ab3-1c82-4f50-a011-adc4a3581ba5 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:54.625856 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-4c6c4ea8-1fac-432b-a7a0-b8b421c35c92 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.242657 Aug 05 20:07:54.626435 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 261/518] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:54 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:54.629408 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-85a71ab3-1c82-4f50-a011-adc4a3581ba5 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.249826 Aug 05 20:07:54.630014 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 258/519] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:54 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:55.572876 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-8547c962-dab9-4233-89ef-ddddd4f99be1 req-8b464ca5-5974-4a5b-b5d2-45f44f975291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67d9e448-6ea5-4514-ac0a-9d7fcc2b590d", "name": "network-vif-plugged", "status": "completed", "tag": "987841ac-6b76-4047-8e5f-66073582dcc7"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:55.584215 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-8547c962-dab9-4233-89ef-ddddd4f99be1 req-8b464ca5-5974-4a5b-b5d2-45f44f975291 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:55.584787 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-8547c962-dab9-4233-89ef-ddddd4f99be1 req-8b464ca5-5974-4a5b-b5d2-45f44f975291 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:55.585216 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-8547c962-dab9-4233-89ef-ddddd4f99be1 req-8b464ca5-5974-4a5b-b5d2-45f44f975291 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:55.600911 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-8547c962-dab9-4233-89ef-ddddd4f99be1 req-8b464ca5-5974-4a5b-b5d2-45f44f975291 service nova] Creating event network-vif-plugged:987841ac-6b76-4047-8e5f-66073582dcc7 for instance 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d on hv-cinder-85221 Aug 05 20:07:55.606151 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-8547c962-dab9-4233-89ef-ddddd4f99be1 req-8b464ca5-5974-4a5b-b5d2-45f44f975291 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037029 Aug 05 20:07:55.606743 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 262/520] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:07:55.653942 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-1980d405-b8f1-4568-8640-bc6101a45bbf tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:55.654550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-1980d405-b8f1-4568-8640-bc6101a45bbf tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:55.660533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:07:55.673294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-cd90dc48-a712-4e69-8bb6-b2594e0acaea tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:55.673989 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-cd90dc48-a712-4e69-8bb6-b2594e0acaea tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:55.676067 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1980d405-b8f1-4568-8640-bc6101a45bbf tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:55.676713 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1980d405-b8f1-4568-8640-bc6101a45bbf tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:55.677232 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1980d405-b8f1-4568-8640-bc6101a45bbf tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:55.678060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1980d405-b8f1-4568-8640-bc6101a45bbf tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:55.678583 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1980d405-b8f1-4568-8640-bc6101a45bbf tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:55.679103 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1980d405-b8f1-4568-8640-bc6101a45bbf tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:55.680135 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cd90dc48-a712-4e69-8bb6-b2594e0acaea tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:55.680716 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cd90dc48-a712-4e69-8bb6-b2594e0acaea tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:55.681156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cd90dc48-a712-4e69-8bb6-b2594e0acaea tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:55.681841 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cd90dc48-a712-4e69-8bb6-b2594e0acaea tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:55.682293 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cd90dc48-a712-4e69-8bb6-b2594e0acaea tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:55.682720 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cd90dc48-a712-4e69-8bb6-b2594e0acaea tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:55.882062 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-cd90dc48-a712-4e69-8bb6-b2594e0acaea tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:55.887131 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-1980d405-b8f1-4568-8640-bc6101a45bbf tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:55.896309 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-1980d405-b8f1-4568-8640-bc6101a45bbf tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.252670 Aug 05 20:07:55.897398 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 259/521] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:55 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:55.899658 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-cd90dc48-a712-4e69-8bb6-b2594e0acaea tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.235592 Aug 05 20:07:55.900365 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 263/522] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:55 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:56.209175 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-db65591a-a8ab-417a-9b33-bd9ca7c66c33 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "700ac612-fd67-4a2c-8a70-a7db07eb5a4a"}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:07:56.211636 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-db65591a-a8ab-417a-9b33-bd9ca7c66c33 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:56.218023 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-db65591a-a8ab-417a-9b33-bd9ca7c66c33 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:56.218512 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-db65591a-a8ab-417a-9b33-bd9ca7c66c33 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:56.218945 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-db65591a-a8ab-417a-9b33-bd9ca7c66c33 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:56.219632 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-db65591a-a8ab-417a-9b33-bd9ca7c66c33 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:56.220087 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-db65591a-a8ab-417a-9b33-bd9ca7c66c33 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:56.220508 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-db65591a-a8ab-417a-9b33-bd9ca7c66c33 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:56.918184 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-9d6d3d47-4ada-4948-8701-9d243c560438 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:56.918809 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-9d6d3d47-4ada-4948-8701-9d243c560438 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:56.925316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9d6d3d47-4ada-4948-8701-9d243c560438 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:56.925802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9d6d3d47-4ada-4948-8701-9d243c560438 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:56.926237 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9d6d3d47-4ada-4948-8701-9d243c560438 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:56.926927 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9d6d3d47-4ada-4948-8701-9d243c560438 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:56.927381 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9d6d3d47-4ada-4948-8701-9d243c560438 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:56.927813 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9d6d3d47-4ada-4948-8701-9d243c560438 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:57.055295 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-9d6d3d47-4ada-4948-8701-9d243c560438 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:57.063015 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-9d6d3d47-4ada-4948-8701-9d243c560438 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.148808 Aug 05 20:07:57.063573 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 264/523] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:56 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:57.068208 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4d44ab54-0de7-4a88-879a-af2d0928dd5d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:57.068834 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-4d44ab54-0de7-4a88-879a-af2d0928dd5d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:57.074810 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4d44ab54-0de7-4a88-879a-af2d0928dd5d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:57.075295 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4d44ab54-0de7-4a88-879a-af2d0928dd5d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:57.075735 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4d44ab54-0de7-4a88-879a-af2d0928dd5d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:57.076399 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4d44ab54-0de7-4a88-879a-af2d0928dd5d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:57.076872 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4d44ab54-0de7-4a88-879a-af2d0928dd5d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:57.077288 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4d44ab54-0de7-4a88-879a-af2d0928dd5d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:57.210691 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-4d44ab54-0de7-4a88-879a-af2d0928dd5d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:57.219077 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-4d44ab54-0de7-4a88-879a-af2d0928dd5d tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.154482 Aug 05 20:07:57.219652 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 265/524] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:57 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:58.083429 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-5d165a09-61a9-46f5-8aa4-357b0185e688 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:58.084322 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-5d165a09-61a9-46f5-8aa4-357b0185e688 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:58.091912 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5d165a09-61a9-46f5-8aa4-357b0185e688 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:58.092420 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5d165a09-61a9-46f5-8aa4-357b0185e688 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:58.093008 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5d165a09-61a9-46f5-8aa4-357b0185e688 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:58.093715 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5d165a09-61a9-46f5-8aa4-357b0185e688 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:58.094346 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5d165a09-61a9-46f5-8aa4-357b0185e688 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:58.094889 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5d165a09-61a9-46f5-8aa4-357b0185e688 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:58.240331 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-5d165a09-61a9-46f5-8aa4-357b0185e688 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:58.252379 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-5d165a09-61a9-46f5-8aa4-357b0185e688 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.172654 Aug 05 20:07:58.253045 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 266/525] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:58 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:58.260063 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-6d642bd8-fc83-4e30-8596-99fb7c1b7862 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:58.260063 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-6d642bd8-fc83-4e30-8596-99fb7c1b7862 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:58.264875 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6d642bd8-fc83-4e30-8596-99fb7c1b7862 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:58.265356 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6d642bd8-fc83-4e30-8596-99fb7c1b7862 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:58.265848 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6d642bd8-fc83-4e30-8596-99fb7c1b7862 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:58.266559 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6d642bd8-fc83-4e30-8596-99fb7c1b7862 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:58.267015 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6d642bd8-fc83-4e30-8596-99fb7c1b7862 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:58.267441 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6d642bd8-fc83-4e30-8596-99fb7c1b7862 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:58.397184 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-6d642bd8-fc83-4e30-8596-99fb7c1b7862 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:58.405179 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-6d642bd8-fc83-4e30-8596-99fb7c1b7862 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.151180 Aug 05 20:07:58.405743 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 267/526] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:58 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:07:59.272585 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-db2220bd-8823-4666-9c52-6b1128efb85b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:59.273232 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-db2220bd-8823-4666-9c52-6b1128efb85b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:59.280281 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-db2220bd-8823-4666-9c52-6b1128efb85b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:59.280802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-db2220bd-8823-4666-9c52-6b1128efb85b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:59.281242 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-db2220bd-8823-4666-9c52-6b1128efb85b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:59.281928 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-db2220bd-8823-4666-9c52-6b1128efb85b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:59.282382 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-db2220bd-8823-4666-9c52-6b1128efb85b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:59.282804 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-db2220bd-8823-4666-9c52-6b1128efb85b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:59.412809 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-db2220bd-8823-4666-9c52-6b1128efb85b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:59.420767 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-db2220bd-8823-4666-9c52-6b1128efb85b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.151980 Aug 05 20:07:59.421321 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 268/527] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:59 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:07:59.425618 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-530987a1-447e-4d4d-a9f4-04eeee7d883f tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:07:59.426368 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-530987a1-447e-4d4d-a9f4-04eeee7d883f tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:07:59.431758 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-530987a1-447e-4d4d-a9f4-04eeee7d883f tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:59.432231 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-530987a1-447e-4d4d-a9f4-04eeee7d883f tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:59.432705 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-530987a1-447e-4d4d-a9f4-04eeee7d883f tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:59.433956 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-530987a1-447e-4d4d-a9f4-04eeee7d883f tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:07:59.434406 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-530987a1-447e-4d4d-a9f4-04eeee7d883f tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:07:59.434824 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-530987a1-447e-4d4d-a9f4-04eeee7d883f tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:07:59.564182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-530987a1-447e-4d4d-a9f4-04eeee7d883f tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:07:59.571463 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-530987a1-447e-4d4d-a9f4-04eeee7d883f tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.149230 Aug 05 20:07:59.572018 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 269/528] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:07:59 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:00.442080 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b79348d6-5e66-456a-b77e-9091fd307d24 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:00.442734 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-b79348d6-5e66-456a-b77e-9091fd307d24 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:00.444994 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:00.450972 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b79348d6-5e66-456a-b77e-9091fd307d24 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:00.451451 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b79348d6-5e66-456a-b77e-9091fd307d24 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:00.451880 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b79348d6-5e66-456a-b77e-9091fd307d24 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:00.452563 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b79348d6-5e66-456a-b77e-9091fd307d24 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:00.453034 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b79348d6-5e66-456a-b77e-9091fd307d24 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:00.453454 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b79348d6-5e66-456a-b77e-9091fd307d24 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:00.597091 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-b79348d6-5e66-456a-b77e-9091fd307d24 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:00.606153 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b79348d6-5e66-456a-b77e-9091fd307d24 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.167400 Aug 05 20:08:00.606843 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 270/529] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:00 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:00.614941 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-39fdbc96-5577-40ce-94ce-9b86e3bbefb3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:00.614941 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-39fdbc96-5577-40ce-94ce-9b86e3bbefb3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:00.618535 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-39fdbc96-5577-40ce-94ce-9b86e3bbefb3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:00.619172 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-39fdbc96-5577-40ce-94ce-9b86e3bbefb3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:00.619617 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-39fdbc96-5577-40ce-94ce-9b86e3bbefb3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:00.620318 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-39fdbc96-5577-40ce-94ce-9b86e3bbefb3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:00.621440 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-39fdbc96-5577-40ce-94ce-9b86e3bbefb3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:00.621852 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-39fdbc96-5577-40ce-94ce-9b86e3bbefb3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:00.773974 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-39fdbc96-5577-40ce-94ce-9b86e3bbefb3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:00.782393 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-39fdbc96-5577-40ce-94ce-9b86e3bbefb3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.174514 Aug 05 20:08:00.783175 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 271/530] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:00 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:01.627977 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-9e8b448c-1bd1-4e92-a3c3-bbc5c814e22f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:01.628642 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-9e8b448c-1bd1-4e92-a3c3-bbc5c814e22f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:01.634633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9e8b448c-1bd1-4e92-a3c3-bbc5c814e22f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:01.635113 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9e8b448c-1bd1-4e92-a3c3-bbc5c814e22f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:01.635539 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9e8b448c-1bd1-4e92-a3c3-bbc5c814e22f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:01.636247 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9e8b448c-1bd1-4e92-a3c3-bbc5c814e22f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:01.636722 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9e8b448c-1bd1-4e92-a3c3-bbc5c814e22f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:01.637141 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9e8b448c-1bd1-4e92-a3c3-bbc5c814e22f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:01.763373 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-9e8b448c-1bd1-4e92-a3c3-bbc5c814e22f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:01.770944 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-9e8b448c-1bd1-4e92-a3c3-bbc5c814e22f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.146754 Aug 05 20:08:01.771494 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 272/531] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:01 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:01.802737 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-581f04c4-9657-4283-afaa-790ee28ccf82 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:01.803330 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-581f04c4-9657-4283-afaa-790ee28ccf82 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:01.809674 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-581f04c4-9657-4283-afaa-790ee28ccf82 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:01.810151 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-581f04c4-9657-4283-afaa-790ee28ccf82 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:01.810579 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-581f04c4-9657-4283-afaa-790ee28ccf82 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:01.811281 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-581f04c4-9657-4283-afaa-790ee28ccf82 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:01.811730 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-581f04c4-9657-4283-afaa-790ee28ccf82 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:01.812147 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-581f04c4-9657-4283-afaa-790ee28ccf82 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:01.941627 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-581f04c4-9657-4283-afaa-790ee28ccf82 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:01.949718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-581f04c4-9657-4283-afaa-790ee28ccf82 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.149739 Aug 05 20:08:01.950468 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 273/532] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:01 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:02.797974 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-62587172-f1da-4c50-a9c6-41ef3619954b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:02.797974 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-62587172-f1da-4c50-a9c6-41ef3619954b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:02.804312 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-62587172-f1da-4c50-a9c6-41ef3619954b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:02.804837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-62587172-f1da-4c50-a9c6-41ef3619954b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:02.805274 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-62587172-f1da-4c50-a9c6-41ef3619954b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:02.806048 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-62587172-f1da-4c50-a9c6-41ef3619954b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:02.806500 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-62587172-f1da-4c50-a9c6-41ef3619954b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:02.806927 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-62587172-f1da-4c50-a9c6-41ef3619954b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:02.940205 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-62587172-f1da-4c50-a9c6-41ef3619954b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:02.947633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-62587172-f1da-4c50-a9c6-41ef3619954b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.157514 Aug 05 20:08:02.948192 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 274/533] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:02 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:02.971343 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-da3640ab-00de-4c7d-a17a-815aeaf44c84 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:02.971960 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-da3640ab-00de-4c7d-a17a-815aeaf44c84 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:02.977952 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-da3640ab-00de-4c7d-a17a-815aeaf44c84 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:02.978443 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-da3640ab-00de-4c7d-a17a-815aeaf44c84 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:02.978878 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-da3640ab-00de-4c7d-a17a-815aeaf44c84 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:02.979578 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-da3640ab-00de-4c7d-a17a-815aeaf44c84 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:02.980028 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-da3640ab-00de-4c7d-a17a-815aeaf44c84 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:02.980456 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-da3640ab-00de-4c7d-a17a-815aeaf44c84 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:03.117505 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-da3640ab-00de-4c7d-a17a-815aeaf44c84 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:03.126056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-da3640ab-00de-4c7d-a17a-815aeaf44c84 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.158459 Aug 05 20:08:03.126676 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 275/534] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:02 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:03.969037 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-3781ff82-b68a-4493-abc4-eaa8ec5d10ad tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:03.969696 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-3781ff82-b68a-4493-abc4-eaa8ec5d10ad tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:03.975939 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3781ff82-b68a-4493-abc4-eaa8ec5d10ad tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:03.976426 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3781ff82-b68a-4493-abc4-eaa8ec5d10ad tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:03.976905 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3781ff82-b68a-4493-abc4-eaa8ec5d10ad tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:03.977601 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3781ff82-b68a-4493-abc4-eaa8ec5d10ad tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:03.978059 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3781ff82-b68a-4493-abc4-eaa8ec5d10ad tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:03.978488 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3781ff82-b68a-4493-abc4-eaa8ec5d10ad tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:03.996459 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=100 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:04.104680 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-3781ff82-b68a-4493-abc4-eaa8ec5d10ad tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:04.112667 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-3781ff82-b68a-4493-abc4-eaa8ec5d10ad tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.148152 Aug 05 20:08:04.113231 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 276/535] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:03 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:04.148071 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-f987f757-492f-4b8b-bda1-8ff7d30a44cb tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:04.148716 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-f987f757-492f-4b8b-bda1-8ff7d30a44cb tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:04.155848 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f987f757-492f-4b8b-bda1-8ff7d30a44cb tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:04.156336 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f987f757-492f-4b8b-bda1-8ff7d30a44cb tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:04.156813 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f987f757-492f-4b8b-bda1-8ff7d30a44cb tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:04.157520 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f987f757-492f-4b8b-bda1-8ff7d30a44cb tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:04.157954 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f987f757-492f-4b8b-bda1-8ff7d30a44cb tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:04.158381 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f987f757-492f-4b8b-bda1-8ff7d30a44cb tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:04.287870 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-f987f757-492f-4b8b-bda1-8ff7d30a44cb tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:04.296090 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-f987f757-492f-4b8b-bda1-8ff7d30a44cb tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.151793 Aug 05 20:08:04.296668 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 277/536] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:04 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:05.133047 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-99ca1a4a-034b-4c6f-8e80-5b76bd0b9f7f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:05.133698 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-99ca1a4a-034b-4c6f-8e80-5b76bd0b9f7f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:05.141370 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-99ca1a4a-034b-4c6f-8e80-5b76bd0b9f7f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:05.141865 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-99ca1a4a-034b-4c6f-8e80-5b76bd0b9f7f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:05.142298 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-99ca1a4a-034b-4c6f-8e80-5b76bd0b9f7f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:05.143011 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-99ca1a4a-034b-4c6f-8e80-5b76bd0b9f7f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:05.143451 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-99ca1a4a-034b-4c6f-8e80-5b76bd0b9f7f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:05.143876 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-99ca1a4a-034b-4c6f-8e80-5b76bd0b9f7f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:05.510629 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-99ca1a4a-034b-4c6f-8e80-5b76bd0b9f7f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:05.518730 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-99ca1a4a-034b-4c6f-8e80-5b76bd0b9f7f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.389612 Aug 05 20:08:05.519294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 278/537] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:05 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:05.523622 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-1893adea-2d74-4a94-8ef2-ecd82168a6ed tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:05.524231 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-1893adea-2d74-4a94-8ef2-ecd82168a6ed tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:05.530829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1893adea-2d74-4a94-8ef2-ecd82168a6ed tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:05.531324 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1893adea-2d74-4a94-8ef2-ecd82168a6ed tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:05.531759 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1893adea-2d74-4a94-8ef2-ecd82168a6ed tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:05.532446 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1893adea-2d74-4a94-8ef2-ecd82168a6ed tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:05.532936 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1893adea-2d74-4a94-8ef2-ecd82168a6ed tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:05.533414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1893adea-2d74-4a94-8ef2-ecd82168a6ed tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:05.663145 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-1893adea-2d74-4a94-8ef2-ecd82168a6ed tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:05.671453 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-1893adea-2d74-4a94-8ef2-ecd82168a6ed tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.151225 Aug 05 20:08:05.672011 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 279/538] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:05 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:06.216697 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=3 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:06.294763 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=72 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:06.542782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-cda310a6-7627-471a-80df-a9498121bdda tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:06.544512 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-cda310a6-7627-471a-80df-a9498121bdda tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:06.561109 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cda310a6-7627-471a-80df-a9498121bdda tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:06.561642 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cda310a6-7627-471a-80df-a9498121bdda tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:06.562297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cda310a6-7627-471a-80df-a9498121bdda tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:06.563192 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cda310a6-7627-471a-80df-a9498121bdda tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:06.563790 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cda310a6-7627-471a-80df-a9498121bdda tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:06.564219 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cda310a6-7627-471a-80df-a9498121bdda tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:06.690091 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-db65591a-a8ab-417a-9b33-bd9ca7c66c33 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "POST /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.484498 Aug 05 20:08:06.696119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 260/539] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Aug 5 20:07:56 2022] POST /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90/os-volume_attachments => generated 194 bytes in 10491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:08:06.714453 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-cdf0cf32-4691-42f1-8b83-8ba13c601d4e tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:06.715153 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-cdf0cf32-4691-42f1-8b83-8ba13c601d4e tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:06.721752 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cdf0cf32-4691-42f1-8b83-8ba13c601d4e tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:06.722307 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cdf0cf32-4691-42f1-8b83-8ba13c601d4e tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:06.722748 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cdf0cf32-4691-42f1-8b83-8ba13c601d4e tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:06.723454 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cdf0cf32-4691-42f1-8b83-8ba13c601d4e tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:06.723914 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cdf0cf32-4691-42f1-8b83-8ba13c601d4e tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:06.724336 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cdf0cf32-4691-42f1-8b83-8ba13c601d4e tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:06.823550 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-cda310a6-7627-471a-80df-a9498121bdda tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:06.831238 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-cda310a6-7627-471a-80df-a9498121bdda tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.295885 Aug 05 20:08:06.831810 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 280/540] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:06 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:06.947891 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-cdf0cf32-4691-42f1-8b83-8ba13c601d4e tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:06.955523 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-cdf0cf32-4691-42f1-8b83-8ba13c601d4e tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.245683 Aug 05 20:08:06.956434 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 261/541] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:06 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:07.190535 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-74df7acc-c039-4bf1-8ee6-7eb5bf18b3e2 req-070fa061-29a4-4660-aa0e-faa97b740d22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9a46a51-71f3-4aa6-ab85-c4d514de3760", "tag": "543b6e01-d59d-496a-ba4f-c4f68f78dad4"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:08:07.199825 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-74df7acc-c039-4bf1-8ee6-7eb5bf18b3e2 req-070fa061-29a4-4660-aa0e-faa97b740d22 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:07.201087 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-74df7acc-c039-4bf1-8ee6-7eb5bf18b3e2 req-070fa061-29a4-4660-aa0e-faa97b740d22 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:07.201515 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-74df7acc-c039-4bf1-8ee6-7eb5bf18b3e2 req-070fa061-29a4-4660-aa0e-faa97b740d22 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:07.212452 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-74df7acc-c039-4bf1-8ee6-7eb5bf18b3e2 req-070fa061-29a4-4660-aa0e-faa97b740d22 service nova] Creating event network-changed:543b6e01-d59d-496a-ba4f-c4f68f78dad4 for instance a9a46a51-71f3-4aa6-ab85-c4d514de3760 on hv-cinder-85221 Aug 05 20:08:07.217580 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-74df7acc-c039-4bf1-8ee6-7eb5bf18b3e2 req-070fa061-29a4-4660-aa0e-faa97b740d22 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030720 Aug 05 20:08:07.218187 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 281/542] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:08:07.851314 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-c9fe49a4-46b9-41a2-9c92-a8ac36919ba6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:07.851927 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-c9fe49a4-46b9-41a2-9c92-a8ac36919ba6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:07.858802 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c9fe49a4-46b9-41a2-9c92-a8ac36919ba6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:07.859289 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c9fe49a4-46b9-41a2-9c92-a8ac36919ba6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:07.859721 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c9fe49a4-46b9-41a2-9c92-a8ac36919ba6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:07.860409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c9fe49a4-46b9-41a2-9c92-a8ac36919ba6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:07.860936 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c9fe49a4-46b9-41a2-9c92-a8ac36919ba6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:07.861447 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c9fe49a4-46b9-41a2-9c92-a8ac36919ba6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:07.977466 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-c54f7404-a4a3-4bfa-8cd9-a999ad914d24 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:07.978169 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-c54f7404-a4a3-4bfa-8cd9-a999ad914d24 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:07.984871 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c54f7404-a4a3-4bfa-8cd9-a999ad914d24 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:07.985361 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c54f7404-a4a3-4bfa-8cd9-a999ad914d24 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:07.985802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c54f7404-a4a3-4bfa-8cd9-a999ad914d24 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:07.986500 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c54f7404-a4a3-4bfa-8cd9-a999ad914d24 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:07.986956 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c54f7404-a4a3-4bfa-8cd9-a999ad914d24 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:07.987382 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c54f7404-a4a3-4bfa-8cd9-a999ad914d24 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:07.992605 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-c9fe49a4-46b9-41a2-9c92-a8ac36919ba6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:08.000099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-c9fe49a4-46b9-41a2-9c92-a8ac36919ba6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.152620 Aug 05 20:08:08.000684 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 262/543] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:07 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:08.125572 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-c54f7404-a4a3-4bfa-8cd9-a999ad914d24 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:08.134056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-c54f7404-a4a3-4bfa-8cd9-a999ad914d24 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.161121 Aug 05 20:08:08.134674 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 282/544] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:07 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:09.020695 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-0d870e7f-181b-469a-9dda-88e354f38eb6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:09.021329 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-0d870e7f-181b-469a-9dda-88e354f38eb6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:09.027685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0d870e7f-181b-469a-9dda-88e354f38eb6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:09.028164 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0d870e7f-181b-469a-9dda-88e354f38eb6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:09.028619 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0d870e7f-181b-469a-9dda-88e354f38eb6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:09.030576 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0d870e7f-181b-469a-9dda-88e354f38eb6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:09.031038 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0d870e7f-181b-469a-9dda-88e354f38eb6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:09.031460 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0d870e7f-181b-469a-9dda-88e354f38eb6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:09.155870 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-822fbf00-ec06-41e4-ab63-e564f8760d2c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:09.156488 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-822fbf00-ec06-41e4-ab63-e564f8760d2c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:09.162862 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-822fbf00-ec06-41e4-ab63-e564f8760d2c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:09.163351 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-822fbf00-ec06-41e4-ab63-e564f8760d2c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:09.163789 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-822fbf00-ec06-41e4-ab63-e564f8760d2c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:09.164488 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-822fbf00-ec06-41e4-ab63-e564f8760d2c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:09.164970 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-822fbf00-ec06-41e4-ab63-e564f8760d2c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:09.165392 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-822fbf00-ec06-41e4-ab63-e564f8760d2c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:09.168027 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-0d870e7f-181b-469a-9dda-88e354f38eb6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:09.177157 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-0d870e7f-181b-469a-9dda-88e354f38eb6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.160294 Aug 05 20:08:09.177744 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 263/545] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:09 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:09.300535 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-822fbf00-ec06-41e4-ab63-e564f8760d2c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:09.308001 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-822fbf00-ec06-41e4-ab63-e564f8760d2c tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.156668 Aug 05 20:08:09.308555 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 283/546] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:09 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:10.198292 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9b05f17a-23b1-468f-a074-d3a25c72819f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:10.198899 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-9b05f17a-23b1-468f-a074-d3a25c72819f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:10.206388 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9b05f17a-23b1-468f-a074-d3a25c72819f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:10.206877 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9b05f17a-23b1-468f-a074-d3a25c72819f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:10.207314 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9b05f17a-23b1-468f-a074-d3a25c72819f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:10.208017 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9b05f17a-23b1-468f-a074-d3a25c72819f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:10.208487 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9b05f17a-23b1-468f-a074-d3a25c72819f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:10.209300 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9b05f17a-23b1-468f-a074-d3a25c72819f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:10.330424 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ca45ba2a-4a0c-460e-90ef-f283f853e139 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:10.331043 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-ca45ba2a-4a0c-460e-90ef-f283f853e139 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:10.338025 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9b05f17a-23b1-468f-a074-d3a25c72819f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:10.338274 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ca45ba2a-4a0c-460e-90ef-f283f853e139 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:10.338767 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ca45ba2a-4a0c-460e-90ef-f283f853e139 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:10.339204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ca45ba2a-4a0c-460e-90ef-f283f853e139 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:10.339909 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ca45ba2a-4a0c-460e-90ef-f283f853e139 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:10.340365 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ca45ba2a-4a0c-460e-90ef-f283f853e139 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:10.340813 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ca45ba2a-4a0c-460e-90ef-f283f853e139 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:10.345595 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-9b05f17a-23b1-468f-a074-d3a25c72819f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.151195 Aug 05 20:08:10.346177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 264/547] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:10 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:10.473857 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-ca45ba2a-4a0c-460e-90ef-f283f853e139 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:10.481366 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-ca45ba2a-4a0c-460e-90ef-f283f853e139 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1314 microversion: 2.1 time: 0.155912 Aug 05 20:08:10.482595 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 284/548] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:10 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:11.127242 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e1ec7d03-51d7-44e4-b9ba-9b19114e28e2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:11.127733 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e1ec7d03-51d7-44e4-b9ba-9b19114e28e2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:11.133656 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e1ec7d03-51d7-44e4-b9ba-9b19114e28e2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:11.134133 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e1ec7d03-51d7-44e4-b9ba-9b19114e28e2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:11.134557 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e1ec7d03-51d7-44e4-b9ba-9b19114e28e2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:11.135233 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e1ec7d03-51d7-44e4-b9ba-9b19114e28e2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:11.135679 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e1ec7d03-51d7-44e4-b9ba-9b19114e28e2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:11.136097 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e1ec7d03-51d7-44e4-b9ba-9b19114e28e2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:11.262564 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.objects.instance [None req-e1ec7d03-51d7-44e4-b9ba-9b19114e28e2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lazy-loading 'services' on Instance uuid daea58f2-4fe8-42e5-afdb-c0b8d47b963c {{(pid=118191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:08:11.366728 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-de8c1263-43a4-427c-bc7d-83be86db1639 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:11.367512 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-de8c1263-43a4-427c-bc7d-83be86db1639 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:11.374837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de8c1263-43a4-427c-bc7d-83be86db1639 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:11.375426 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de8c1263-43a4-427c-bc7d-83be86db1639 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:11.375943 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de8c1263-43a4-427c-bc7d-83be86db1639 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:11.376802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de8c1263-43a4-427c-bc7d-83be86db1639 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:11.377299 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de8c1263-43a4-427c-bc7d-83be86db1639 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:11.377916 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de8c1263-43a4-427c-bc7d-83be86db1639 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:11.387025 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e1ec7d03-51d7-44e4-b9ba-9b19114e28e2 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "DELETE /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c/os-volume_attachments/f2463ad9-158e-4107-8071-4445e32aed6a" status: 202 len: 0 microversion: 2.1 time: 0.263403 Aug 05 20:08:11.391751 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 265/549] 10.222.0.39 () {58 vars in 1416 bytes} [Fri Aug 5 20:08:11 2022] DELETE /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c/os-volume_attachments/f2463ad9-158e-4107-8071-4445e32aed6a => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:08:11.504563 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7b4eee64-63ad-4b12-9e0f-76c8d27e260b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:11.505655 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-7b4eee64-63ad-4b12-9e0f-76c8d27e260b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:11.514776 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7b4eee64-63ad-4b12-9e0f-76c8d27e260b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:11.515455 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7b4eee64-63ad-4b12-9e0f-76c8d27e260b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:11.516137 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7b4eee64-63ad-4b12-9e0f-76c8d27e260b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:11.517087 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7b4eee64-63ad-4b12-9e0f-76c8d27e260b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:11.517676 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7b4eee64-63ad-4b12-9e0f-76c8d27e260b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:11.518104 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7b4eee64-63ad-4b12-9e0f-76c8d27e260b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:11.591340 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-de8c1263-43a4-427c-bc7d-83be86db1639 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:11.599824 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-de8c1263-43a4-427c-bc7d-83be86db1639 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.236942 Aug 05 20:08:11.601545 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 285/550] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:11 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:11.750586 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-7b4eee64-63ad-4b12-9e0f-76c8d27e260b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:11.758074 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-7b4eee64-63ad-4b12-9e0f-76c8d27e260b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1498 microversion: 2.1 time: 0.258862 Aug 05 20:08:11.758641 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 266/551] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:11 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1498 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:12.436030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-c9fd5359-1a0e-44ab-b51c-a01bb7eea3f3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:12.436522 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-c9fd5359-1a0e-44ab-b51c-a01bb7eea3f3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:12.442955 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c9fd5359-1a0e-44ab-b51c-a01bb7eea3f3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:12.443443 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c9fd5359-1a0e-44ab-b51c-a01bb7eea3f3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:12.443878 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c9fd5359-1a0e-44ab-b51c-a01bb7eea3f3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:12.444590 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c9fd5359-1a0e-44ab-b51c-a01bb7eea3f3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:12.445052 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c9fd5359-1a0e-44ab-b51c-a01bb7eea3f3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:12.445475 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c9fd5359-1a0e-44ab-b51c-a01bb7eea3f3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:12.472042 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-c9fd5359-1a0e-44ab-b51c-a01bb7eea3f3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Going to try to terminate instance {{(pid=118192) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:08:12.548741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-c9fd5359-1a0e-44ab-b51c-a01bb7eea3f3 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "DELETE /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 204 len: 0 microversion: 2.1 time: 0.116302 Aug 05 20:08:12.549324 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 286/552] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:08:12 2022] DELETE /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:08:12.557597 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-979a7de5-7fda-4fcf-85d6-69702ef4f143 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:12.558194 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-979a7de5-7fda-4fcf-85d6-69702ef4f143 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:12.564513 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-979a7de5-7fda-4fcf-85d6-69702ef4f143 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:12.565034 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-979a7de5-7fda-4fcf-85d6-69702ef4f143 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:12.565504 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-979a7de5-7fda-4fcf-85d6-69702ef4f143 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:12.566192 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-979a7de5-7fda-4fcf-85d6-69702ef4f143 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:12.566640 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-979a7de5-7fda-4fcf-85d6-69702ef4f143 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:12.567067 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-979a7de5-7fda-4fcf-85d6-69702ef4f143 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:12.621986 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-5dc7fa8d-e0dd-4544-bcb2-9c9c14876aa9 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:12.622723 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-5dc7fa8d-e0dd-4544-bcb2-9c9c14876aa9 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:12.629152 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5dc7fa8d-e0dd-4544-bcb2-9c9c14876aa9 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:12.629651 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5dc7fa8d-e0dd-4544-bcb2-9c9c14876aa9 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:12.630092 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5dc7fa8d-e0dd-4544-bcb2-9c9c14876aa9 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:12.630804 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5dc7fa8d-e0dd-4544-bcb2-9c9c14876aa9 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:12.631263 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5dc7fa8d-e0dd-4544-bcb2-9c9c14876aa9 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:12.631700 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5dc7fa8d-e0dd-4544-bcb2-9c9c14876aa9 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:12.739439 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-979a7de5-7fda-4fcf-85d6-69702ef4f143 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:12.747057 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-979a7de5-7fda-4fcf-85d6-69702ef4f143 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1504 microversion: 2.1 time: 0.193261 Aug 05 20:08:12.748388 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 267/553] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:12 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1504 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:12.785172 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-5dc7fa8d-e0dd-4544-bcb2-9c9c14876aa9 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:12.792418 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-5dc7fa8d-e0dd-4544-bcb2-9c9c14876aa9 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.174628 Aug 05 20:08:12.793010 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 287/554] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:12 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:13.769996 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-79944cf2-2d18-479d-b8a8-0952697e2228 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:13.770527 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-79944cf2-2d18-479d-b8a8-0952697e2228 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:13.776945 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-79944cf2-2d18-479d-b8a8-0952697e2228 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:13.777425 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-79944cf2-2d18-479d-b8a8-0952697e2228 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:13.777850 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-79944cf2-2d18-479d-b8a8-0952697e2228 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:13.778523 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-79944cf2-2d18-479d-b8a8-0952697e2228 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:13.778968 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-79944cf2-2d18-479d-b8a8-0952697e2228 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:13.779382 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-79944cf2-2d18-479d-b8a8-0952697e2228 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:13.813461 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-5e632e38-0a7c-46b0-8b41-af3a22dc59d6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:13.814177 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-5e632e38-0a7c-46b0-8b41-af3a22dc59d6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:13.820803 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5e632e38-0a7c-46b0-8b41-af3a22dc59d6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:13.821294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5e632e38-0a7c-46b0-8b41-af3a22dc59d6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:13.821729 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5e632e38-0a7c-46b0-8b41-af3a22dc59d6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:13.822424 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5e632e38-0a7c-46b0-8b41-af3a22dc59d6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:13.822874 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5e632e38-0a7c-46b0-8b41-af3a22dc59d6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:13.823298 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5e632e38-0a7c-46b0-8b41-af3a22dc59d6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:13.958531 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-79944cf2-2d18-479d-b8a8-0952697e2228 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:13.965917 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-79944cf2-2d18-479d-b8a8-0952697e2228 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1504 microversion: 2.1 time: 0.199843 Aug 05 20:08:13.966596 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 268/555] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:13 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1504 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:13.988356 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-5e632e38-0a7c-46b0-8b41-af3a22dc59d6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:13.995693 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-5e632e38-0a7c-46b0-8b41-af3a22dc59d6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.186112 Aug 05 20:08:13.996251 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 288/556] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:13 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:14.987404 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-58557f66-e3ad-4aac-a799-c78282b6045a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:14.988024 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-58557f66-e3ad-4aac-a799-c78282b6045a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:14.994484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-58557f66-e3ad-4aac-a799-c78282b6045a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:14.994974 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-58557f66-e3ad-4aac-a799-c78282b6045a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:14.995417 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-58557f66-e3ad-4aac-a799-c78282b6045a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:14.996106 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-58557f66-e3ad-4aac-a799-c78282b6045a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:14.996562 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-58557f66-e3ad-4aac-a799-c78282b6045a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:14.997015 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-58557f66-e3ad-4aac-a799-c78282b6045a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:15.073797 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-290b5ae2-25a3-4477-b180-52f5ce351ca1 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:15.074193 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-290b5ae2-25a3-4477-b180-52f5ce351ca1 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:15.081251 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-290b5ae2-25a3-4477-b180-52f5ce351ca1 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:15.081740 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-290b5ae2-25a3-4477-b180-52f5ce351ca1 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:15.082170 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-290b5ae2-25a3-4477-b180-52f5ce351ca1 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:15.083053 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-290b5ae2-25a3-4477-b180-52f5ce351ca1 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:15.083504 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-290b5ae2-25a3-4477-b180-52f5ce351ca1 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:15.084114 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-290b5ae2-25a3-4477-b180-52f5ce351ca1 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:15.138604 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-58557f66-e3ad-4aac-a799-c78282b6045a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:15.147268 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-58557f66-e3ad-4aac-a799-c78282b6045a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1504 microversion: 2.1 time: 0.163718 Aug 05 20:08:15.147847 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 269/557] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:14 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:15.225273 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-290b5ae2-25a3-4477-b180-52f5ce351ca1 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:15.233566 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-290b5ae2-25a3-4477-b180-52f5ce351ca1 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.163915 Aug 05 20:08:15.234136 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 289/558] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:15 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:16.168704 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-c76cca2c-18ea-4a61-82e6-e10a28855d7a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:16.169409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-c76cca2c-18ea-4a61-82e6-e10a28855d7a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:16.176621 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c76cca2c-18ea-4a61-82e6-e10a28855d7a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:16.177115 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c76cca2c-18ea-4a61-82e6-e10a28855d7a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:16.177550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c76cca2c-18ea-4a61-82e6-e10a28855d7a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:16.178248 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c76cca2c-18ea-4a61-82e6-e10a28855d7a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:16.178703 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c76cca2c-18ea-4a61-82e6-e10a28855d7a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:16.179127 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c76cca2c-18ea-4a61-82e6-e10a28855d7a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:16.254398 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4689e5a1-2547-4914-995a-cab7e87e51ec tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:16.255003 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-4689e5a1-2547-4914-995a-cab7e87e51ec tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:16.261236 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4689e5a1-2547-4914-995a-cab7e87e51ec tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:16.261736 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4689e5a1-2547-4914-995a-cab7e87e51ec tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:16.262174 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4689e5a1-2547-4914-995a-cab7e87e51ec tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:16.263077 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4689e5a1-2547-4914-995a-cab7e87e51ec tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:16.264355 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4689e5a1-2547-4914-995a-cab7e87e51ec tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:16.264814 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4689e5a1-2547-4914-995a-cab7e87e51ec tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:16.374021 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-c76cca2c-18ea-4a61-82e6-e10a28855d7a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:16.382900 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-c76cca2c-18ea-4a61-82e6-e10a28855d7a tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1504 microversion: 2.1 time: 0.218001 Aug 05 20:08:16.383480 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 270/559] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:16 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:16.438206 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-4689e5a1-2547-4914-995a-cab7e87e51ec tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:16.445846 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-4689e5a1-2547-4914-995a-cab7e87e51ec tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.195305 Aug 05 20:08:16.446418 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 290/560] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:16 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:17.405650 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3c73cfd8-7609-4975-ae13-8aa52e1e9f11 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:17.406283 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-3c73cfd8-7609-4975-ae13-8aa52e1e9f11 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:17.413011 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3c73cfd8-7609-4975-ae13-8aa52e1e9f11 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:17.413494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3c73cfd8-7609-4975-ae13-8aa52e1e9f11 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:17.413922 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3c73cfd8-7609-4975-ae13-8aa52e1e9f11 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:17.414607 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3c73cfd8-7609-4975-ae13-8aa52e1e9f11 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:17.415053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3c73cfd8-7609-4975-ae13-8aa52e1e9f11 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:17.415472 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3c73cfd8-7609-4975-ae13-8aa52e1e9f11 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:17.469453 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-32294fe9-4efd-4321-a738-bade01c8a330 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:17.470172 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-32294fe9-4efd-4321-a738-bade01c8a330 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:17.476710 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-32294fe9-4efd-4321-a738-bade01c8a330 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:17.477281 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-32294fe9-4efd-4321-a738-bade01c8a330 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:17.477789 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-32294fe9-4efd-4321-a738-bade01c8a330 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:17.478497 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-32294fe9-4efd-4321-a738-bade01c8a330 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:17.478951 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-32294fe9-4efd-4321-a738-bade01c8a330 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:17.479379 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-32294fe9-4efd-4321-a738-bade01c8a330 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:17.587987 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3c73cfd8-7609-4975-ae13-8aa52e1e9f11 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:17.595879 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3c73cfd8-7609-4975-ae13-8aa52e1e9f11 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1504 microversion: 2.1 time: 0.194210 Aug 05 20:08:17.596555 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 271/561] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:17 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1504 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:17.633667 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-32294fe9-4efd-4321-a738-bade01c8a330 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:17.641528 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-32294fe9-4efd-4321-a738-bade01c8a330 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.176083 Aug 05 20:08:17.642084 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 291/562] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:17 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:18.618320 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-075b1247-57fe-446d-baba-ed6ded8708bd tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:18.618882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-075b1247-57fe-446d-baba-ed6ded8708bd tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:18.625372 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-075b1247-57fe-446d-baba-ed6ded8708bd tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:18.625848 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-075b1247-57fe-446d-baba-ed6ded8708bd tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:18.626277 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-075b1247-57fe-446d-baba-ed6ded8708bd tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:18.626982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-075b1247-57fe-446d-baba-ed6ded8708bd tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:18.627434 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-075b1247-57fe-446d-baba-ed6ded8708bd tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:18.627852 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-075b1247-57fe-446d-baba-ed6ded8708bd tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:18.661614 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-77140599-1d38-48ac-a6ad-f30b03946faa tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:18.662335 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-77140599-1d38-48ac-a6ad-f30b03946faa tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:18.668870 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-77140599-1d38-48ac-a6ad-f30b03946faa tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:18.670809 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-77140599-1d38-48ac-a6ad-f30b03946faa tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:18.671685 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-77140599-1d38-48ac-a6ad-f30b03946faa tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:18.672426 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-77140599-1d38-48ac-a6ad-f30b03946faa tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:18.672934 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-77140599-1d38-48ac-a6ad-f30b03946faa tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:18.673362 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-77140599-1d38-48ac-a6ad-f30b03946faa tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:18.678018 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:18.823482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-075b1247-57fe-446d-baba-ed6ded8708bd tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:18.831612 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-075b1247-57fe-446d-baba-ed6ded8708bd tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1504 microversion: 2.1 time: 0.217094 Aug 05 20:08:18.832299 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 272/563] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:18 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:18.847298 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-77140599-1d38-48ac-a6ad-f30b03946faa tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:18.855424 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-77140599-1d38-48ac-a6ad-f30b03946faa tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.197636 Aug 05 20:08:18.856165 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 292/564] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:18 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:19.854721 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-81fed680-985e-4128-8b47-73eaf0c5f2af tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:19.855532 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-81fed680-985e-4128-8b47-73eaf0c5f2af tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:19.862589 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-81fed680-985e-4128-8b47-73eaf0c5f2af tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:19.863082 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-81fed680-985e-4128-8b47-73eaf0c5f2af tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:19.863515 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-81fed680-985e-4128-8b47-73eaf0c5f2af tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:19.864205 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-81fed680-985e-4128-8b47-73eaf0c5f2af tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:19.865237 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-81fed680-985e-4128-8b47-73eaf0c5f2af tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:19.865237 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-81fed680-985e-4128-8b47-73eaf0c5f2af tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:19.879472 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a1cfb308-bd69-4e3d-b34e-9b4af7f10cbc tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:19.881092 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a1cfb308-bd69-4e3d-b34e-9b4af7f10cbc tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:19.889907 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a1cfb308-bd69-4e3d-b34e-9b4af7f10cbc tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:19.890891 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a1cfb308-bd69-4e3d-b34e-9b4af7f10cbc tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:19.891561 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a1cfb308-bd69-4e3d-b34e-9b4af7f10cbc tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:19.892504 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a1cfb308-bd69-4e3d-b34e-9b4af7f10cbc tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:19.893230 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a1cfb308-bd69-4e3d-b34e-9b4af7f10cbc tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:19.893889 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a1cfb308-bd69-4e3d-b34e-9b4af7f10cbc tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:20.150569 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a1cfb308-bd69-4e3d-b34e-9b4af7f10cbc tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:20.156517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-81fed680-985e-4128-8b47-73eaf0c5f2af tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:20.158182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a1cfb308-bd69-4e3d-b34e-9b4af7f10cbc tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.284378 Aug 05 20:08:20.159015 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 293/565] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:19 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:20.174890 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-81fed680-985e-4128-8b47-73eaf0c5f2af tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1504 microversion: 2.1 time: 0.323978 Aug 05 20:08:20.175464 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 273/566] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:19 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1504 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:20.418276 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-523a3964-94d7-48aa-aa0d-17c5fcc7e165 req-ed5f12e8-cdcf-4dd6-b666-3a548a8a594f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67d9e448-6ea5-4514-ac0a-9d7fcc2b590d", "name": "network-vif-deleted", "tag": "987841ac-6b76-4047-8e5f-66073582dcc7"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:08:20.428251 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-523a3964-94d7-48aa-aa0d-17c5fcc7e165 req-ed5f12e8-cdcf-4dd6-b666-3a548a8a594f service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:20.428767 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-523a3964-94d7-48aa-aa0d-17c5fcc7e165 req-ed5f12e8-cdcf-4dd6-b666-3a548a8a594f service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:20.429201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-523a3964-94d7-48aa-aa0d-17c5fcc7e165 req-ed5f12e8-cdcf-4dd6-b666-3a548a8a594f service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:20.440394 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-523a3964-94d7-48aa-aa0d-17c5fcc7e165 req-ed5f12e8-cdcf-4dd6-b666-3a548a8a594f service nova] Creating event network-vif-deleted:987841ac-6b76-4047-8e5f-66073582dcc7 for instance 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d on hv-cinder-85221 Aug 05 20:08:20.445324 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-523a3964-94d7-48aa-aa0d-17c5fcc7e165 req-ed5f12e8-cdcf-4dd6-b666-3a548a8a594f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086421 Aug 05 20:08:20.445892 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 294/567] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:08:20.587299 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-10a54173-1a43-47d0-b3f0-02749e5fc166 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Action: 'create', calling method: .version_select at 0x7fe3e4e43c10>, body: {"keypair": {"name": "tempest-keypair-1753882173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIL5lxGBBCm8i1hTehZhFyILP2Ip/OSwbftkkz3BSvG0HUusyOHsiXQbQvL5ZlC0ZMqTlN75FlZMrQ57WTw3MSC6jlhrN0MqCtKr1tOtyAgoLjSvejjYKsjedcamEASrLw=="}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:08:20.603361 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-10a54173-1a43-47d0-b3f0-02749e5fc166 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Getting quotas for project 5b265913f9bd46b9b36c18d567d0cf66. Resources: {'key_pairs'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:08:20.607392 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-10a54173-1a43-47d0-b3f0-02749e5fc166 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Getting quotas for user 1afe13c8fbb1468b8ef3d0d0c671208d and project 5b265913f9bd46b9b36c18d567d0cf66. Resources: {'key_pairs'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:08:20.632882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-10a54173-1a43-47d0-b3f0-02749e5fc166 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049723 Aug 05 20:08:20.633517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 274/568] 10.222.0.39 () {60 vars in 1159 bytes} [Fri Aug 5 20:08:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:08:20.780548 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-e511346f-76c7-4b4f-a914-87bf2a6c5229 req-dae1a289-d625-4c7f-85cd-a3552bc09ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a46a51-71f3-4aa6-ab85-c4d514de3760", "name": "network-vif-plugged", "status": "completed", "tag": "543b6e01-d59d-496a-ba4f-c4f68f78dad4"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:08:20.792612 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-e511346f-76c7-4b4f-a914-87bf2a6c5229 req-dae1a289-d625-4c7f-85cd-a3552bc09ec3 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:20.793463 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-e511346f-76c7-4b4f-a914-87bf2a6c5229 req-dae1a289-d625-4c7f-85cd-a3552bc09ec3 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:20.794183 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-e511346f-76c7-4b4f-a914-87bf2a6c5229 req-dae1a289-d625-4c7f-85cd-a3552bc09ec3 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:20.811800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-e511346f-76c7-4b4f-a914-87bf2a6c5229 req-dae1a289-d625-4c7f-85cd-a3552bc09ec3 service nova] Creating event network-vif-plugged:543b6e01-d59d-496a-ba4f-c4f68f78dad4 for instance a9a46a51-71f3-4aa6-ab85-c4d514de3760 on hv-cinder-85221 Aug 05 20:08:20.817460 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-e511346f-76c7-4b4f-a914-87bf2a6c5229 req-dae1a289-d625-4c7f-85cd-a3552bc09ec3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042451 Aug 05 20:08:20.818229 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 295/569] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:08:21.182377 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-8972de16-509a-494e-9293-dc4700420a1e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:21.183005 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-8972de16-509a-494e-9293-dc4700420a1e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:21.190894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8972de16-509a-494e-9293-dc4700420a1e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:21.191614 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8972de16-509a-494e-9293-dc4700420a1e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:21.192347 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8972de16-509a-494e-9293-dc4700420a1e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:21.193081 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8972de16-509a-494e-9293-dc4700420a1e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:21.193536 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8972de16-509a-494e-9293-dc4700420a1e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:21.193962 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8972de16-509a-494e-9293-dc4700420a1e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:21.198116 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-7b301a99-205f-4888-af50-e1e06e9921d0 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:21.199396 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-7b301a99-205f-4888-af50-e1e06e9921d0 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:21.206802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7b301a99-205f-4888-af50-e1e06e9921d0 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:21.207514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7b301a99-205f-4888-af50-e1e06e9921d0 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:21.207955 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7b301a99-205f-4888-af50-e1e06e9921d0 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:21.208695 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7b301a99-205f-4888-af50-e1e06e9921d0 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:21.209154 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7b301a99-205f-4888-af50-e1e06e9921d0 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:21.209585 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7b301a99-205f-4888-af50-e1e06e9921d0 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:21.242197 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7b301a99-205f-4888-af50-e1e06e9921d0 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:21.242819 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7b301a99-205f-4888-af50-e1e06e9921d0 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:21.243264 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7b301a99-205f-4888-af50-e1e06e9921d0 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:21.243717 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.objects.instance [None req-7b301a99-205f-4888-af50-e1e06e9921d0 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lazy-loading 'fault' on Instance uuid 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d {{(pid=118192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:08:21.327745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-7b301a99-205f-4888-af50-e1e06e9921d0 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dbaac800624b85ab8c07a369cf0aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fee7422708346709cc0524d685031b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:21.335828 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-7b301a99-205f-4888-af50-e1e06e9921d0 tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 200 len: 1304 microversion: 2.1 time: 0.142423 Aug 05 20:08:21.339902 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 296/570] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:21 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 1304 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:21.421132 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8972de16-509a-494e-9293-dc4700420a1e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:21.430436 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-8972de16-509a-494e-9293-dc4700420a1e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.255035 Aug 05 20:08:21.431007 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 275/571] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:21 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:22.082918 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4551ad14-6fed-4126-9aea-d6ac11630147 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:22.083420 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-4551ad14-6fed-4126-9aea-d6ac11630147 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:22.094346 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4551ad14-6fed-4126-9aea-d6ac11630147 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:22.094837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4551ad14-6fed-4126-9aea-d6ac11630147 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:22.095276 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4551ad14-6fed-4126-9aea-d6ac11630147 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:22.095979 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4551ad14-6fed-4126-9aea-d6ac11630147 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:22.096435 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4551ad14-6fed-4126-9aea-d6ac11630147 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:22.097072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4551ad14-6fed-4126-9aea-d6ac11630147 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:22.098598 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-c9c4f758-774a-4a69-99a9-5cd9f3adca93 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-67455475", "imageRef": "c148255e-9574-4d10-b9bb-13c9411eda77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d7536c13-8fba-4a9d-87ec-6a7bf401477c"}], "security_groups": [{"name": "tempest-securitygroup--324797709"}], "key_name": "tempest-keypair-1753882173", "user_data": "}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:08:22.122812 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-4551ad14-6fed-4126-9aea-d6ac11630147 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Going to try to terminate instance {{(pid=118192) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:08:22.205327 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-4551ad14-6fed-4126-9aea-d6ac11630147 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "DELETE /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 204 len: 0 microversion: 2.1 time: 0.126061 Aug 05 20:08:22.206070 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 297/572] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:08:22 2022] DELETE /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:08:22.206400 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.network.neutron [None req-c9c4f758-774a-4a69-99a9-5cd9f3adca93 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] validate_networks() for [('d7536c13-8fba-4a9d-87ec-6a7bf401477c', None, None, None, None, None)] {{(pid=118191) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:08:22.214169 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-5544f270-ea71-45ee-9288-62dd6637aa42 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:22.214867 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-5544f270-ea71-45ee-9288-62dd6637aa42 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:22.225834 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5544f270-ea71-45ee-9288-62dd6637aa42 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:22.226331 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5544f270-ea71-45ee-9288-62dd6637aa42 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:22.226771 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5544f270-ea71-45ee-9288-62dd6637aa42 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:22.227512 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5544f270-ea71-45ee-9288-62dd6637aa42 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:22.228025 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5544f270-ea71-45ee-9288-62dd6637aa42 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:22.228400 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5544f270-ea71-45ee-9288-62dd6637aa42 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:22.421999 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-5544f270-ea71-45ee-9288-62dd6637aa42 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:22.429431 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-5544f270-ea71-45ee-9288-62dd6637aa42 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1513 microversion: 2.1 time: 0.219174 Aug 05 20:08:22.430664 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 298/573] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:22 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1513 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:22.435813 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-37ddf293-8c30-48f2-8eea-0b47be8d160b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:22.437260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-37ddf293-8c30-48f2-8eea-0b47be8d160b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] [instance: 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:22.445352 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-37ddf293-8c30-48f2-8eea-0b47be8d160b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:22.446067 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-37ddf293-8c30-48f2-8eea-0b47be8d160b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:22.446444 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-37ddf293-8c30-48f2-8eea-0b47be8d160b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:22.447158 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-37ddf293-8c30-48f2-8eea-0b47be8d160b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:22.447615 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-37ddf293-8c30-48f2-8eea-0b47be8d160b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:22.448046 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-37ddf293-8c30-48f2-8eea-0b47be8d160b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:22.461891 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-37ddf293-8c30-48f2-8eea-0b47be8d160b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] HTTP exception thrown: Instance 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d could not be found. Aug 05 20:08:22.463459 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-37ddf293-8c30-48f2-8eea-0b47be8d160b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Request method failure captured: Aug 05 20:08:22.463459 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d HTTP/1.1 Aug 05 20:08:22.463459 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:08:22.463459 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:08:22.463459 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:08:22.463459 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 0 Aug 05 20:08:22.463459 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:08:22.463459 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:08:22.463459 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:08:22.463459 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:08:22.463459 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XhZwomWtN8b8nUoSSZ4g55IeuK_f0V3UJIxi1gzdlhWdaIJMji0lOI_l1AhWuVOmVdxJH4Jjpn7iAE1RTHhisggfv17ZPyor7sHk14Ln5QYBPAC0kUCl62NkjVxDfNK2CZkr3Yp4eEewWdHCV6Ek7bel7YBcCpN9H_VK7PFdNrCNd8 Aug 05 20:08:22.463459 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:08:22.463459 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:08:22.463459 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:08:22.463459 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:08:22.463459 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:08:22.463459 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:08:22.463459 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: 2fee7422708346709cc0524d685031b3 Aug 05 20:08:22.463459 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-VolumesActionsTest-58740868 Aug 05 20:08:22.463459 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:08:22.463459 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:08:22.465090 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2fee7422708346709cc0524d685031b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2fee7422708346709cc0524d685031b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2fee7422708346709cc0524d685031b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2fee7422708346709cc0524d685031b3", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:08:22.465090 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-VolumesActionsTest-58740868 Aug 05 20:08:22.465090 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: 2fee7422708346709cc0524d685031b3 Aug 05 20:08:22.465090 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-VolumesActionsTest-58740868 Aug 05 20:08:22.465090 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-VolumesActionsTest-58740868-project Aug 05 20:08:22.465090 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:08:22.465090 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:08:22.465090 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: a0dbaac800624b85ab8c07a369cf0aff Aug 05 20:08:22.465090 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-VolumesActionsTest-58740868-project Aug 05 20:08:22.465090 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: > Aug 05 20:08:22.465090 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Instance 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d could not be found. Aug 05 20:08:22.465090 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'id': '67d9e448-6ea5-4514-ac0a-9d7fcc2b590d'} Aug 05 20:08:22.466289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:08:22.466289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:08:22.466289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:08:22.466289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:08:22.466289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:08:22.466289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:08:22.466289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:08:22.466289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:08:22.466289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:08:22.466289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:08:22.466289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d could not be found. Aug 05 20:08:22.466289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:08:22.466289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:08:22.466289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:08:22.466289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:08:22.466289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:08:22.466289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:08:22.466289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:08:22.466289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:08:22.466289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:08:22.469709 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:08:22.469709 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:08:22.469709 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:08:22.469709 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:08:22.469709 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:08:22.469709 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:08:22.469709 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:08:22.469709 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d could not be found. Aug 05 20:08:22.469709 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:08:22.469709 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:08:22.469709 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:08:22.469709 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:08:22.469709 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:08:22.469709 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:08:22.469709 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:08:22.469709 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:08:22.469709 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d could not be found. Aug 05 20:08:22.469709 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:08:22.471094 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-37ddf293-8c30-48f2-8eea-0b47be8d160b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] Returning 404 to user: Instance 67d9e448-6ea5-4514-ac0a-9d7fcc2b590d could not be found. {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:08:22.471094 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-37ddf293-8c30-48f2-8eea-0b47be8d160b tempest-VolumesActionsTest-58740868 tempest-VolumesActionsTest-58740868-project] 10.222.0.39 "GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d" status: 404 len: 111 microversion: 2.1 time: 0.033268 Aug 05 20:08:22.471094 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 299/574] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:22 2022] GET /compute/v2.1/servers/67d9e448-6ea5-4514-ac0a-9d7fcc2b590d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:08:22.472046 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4dfb80a2-65c4-489d-90d8-c53988066059 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:22.472875 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-4dfb80a2-65c4-489d-90d8-c53988066059 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:22.478691 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4dfb80a2-65c4-489d-90d8-c53988066059 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:22.479184 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4dfb80a2-65c4-489d-90d8-c53988066059 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:22.479613 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4dfb80a2-65c4-489d-90d8-c53988066059 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:22.480306 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4dfb80a2-65c4-489d-90d8-c53988066059 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:22.480782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4dfb80a2-65c4-489d-90d8-c53988066059 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:22.481207 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4dfb80a2-65c4-489d-90d8-c53988066059 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:22.974246 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-4dfb80a2-65c4-489d-90d8-c53988066059 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:22.982142 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-4dfb80a2-65c4-489d-90d8-c53988066059 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.515474 Aug 05 20:08:22.983285 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 300/575] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:22 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:23.027518 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-c9c4f758-774a-4a69-99a9-5cd9f3adca93 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Flavor limits 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:08:23.028012 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-c9c4f758-774a-4a69-99a9-5cd9f3adca93 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Image limits 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:08:23.028562 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-c9c4f758-774a-4a69-99a9-5cd9f3adca93 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Flavor pref 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:08:23.029071 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-c9c4f758-774a-4a69-99a9-5cd9f3adca93 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Image pref 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:08:23.030302 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-c9c4f758-774a-4a69-99a9-5cd9f3adca93 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:08:23.039633 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c9c4f758-774a-4a69-99a9-5cd9f3adca93 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:23.040028 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c9c4f758-774a-4a69-99a9-5cd9f3adca93 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:23.040487 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c9c4f758-774a-4a69-99a9-5cd9f3adca93 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:23.041266 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c9c4f758-774a-4a69-99a9-5cd9f3adca93 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:23.041734 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c9c4f758-774a-4a69-99a9-5cd9f3adca93 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:23.042429 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c9c4f758-774a-4a69-99a9-5cd9f3adca93 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:23.062618 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-c9c4f758-774a-4a69-99a9-5cd9f3adca93 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Getting quotas for project 5b265913f9bd46b9b36c18d567d0cf66. Resources: {'cores', 'ram', 'instances'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:08:23.066803 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-c9c4f758-774a-4a69-99a9-5cd9f3adca93 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Getting quotas for user 1afe13c8fbb1468b8ef3d0d0c671208d and project 5b265913f9bd46b9b36c18d567d0cf66. Resources: {'cores', 'ram', 'instances'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:08:23.078279 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-c9c4f758-774a-4a69-99a9-5cd9f3adca93 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Going to run 1 instances... {{(pid=118191) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:08:23.080649 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-c9c4f758-774a-4a69-99a9-5cd9f3adca93 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c148255e-9574-4d10-b9bb-13c9411eda77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118191) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:08:23.133613 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-c9c4f758-774a-4a69-99a9-5cd9f3adca93 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.038807 Aug 05 20:08:23.134323 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 276/576] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Aug 5 20:08:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 1041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 20:08:23.149672 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b0054d4d-7fc5-4825-aa7f-f3d94b387cb3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:23.150486 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-b0054d4d-7fc5-4825-aa7f-f3d94b387cb3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:23.209808 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-b0054d4d-7fc5-4825-aa7f-f3d94b387cb3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:23.216517 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b0054d4d-7fc5-4825-aa7f-f3d94b387cb3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1240 microversion: 2.1 time: 0.071187 Aug 05 20:08:23.217148 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 301/577] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:23 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:23.451312 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-20294852-86a1-47d2-8493-5fbcd1868308 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:23.452003 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-20294852-86a1-47d2-8493-5fbcd1868308 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:23.459926 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-20294852-86a1-47d2-8493-5fbcd1868308 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:23.460415 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-20294852-86a1-47d2-8493-5fbcd1868308 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:23.460882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-20294852-86a1-47d2-8493-5fbcd1868308 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:23.461583 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-20294852-86a1-47d2-8493-5fbcd1868308 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:23.462037 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-20294852-86a1-47d2-8493-5fbcd1868308 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:23.462456 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-20294852-86a1-47d2-8493-5fbcd1868308 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:23.466586 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:23.595761 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-20294852-86a1-47d2-8493-5fbcd1868308 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:23.603706 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-20294852-86a1-47d2-8493-5fbcd1868308 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1513 microversion: 2.1 time: 0.156363 Aug 05 20:08:23.604282 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 277/578] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:23 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:24.004040 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-85d4f512-3267-4930-b928-3c53afd223bb tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:24.004676 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-85d4f512-3267-4930-b928-3c53afd223bb tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:24.010538 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-85d4f512-3267-4930-b928-3c53afd223bb tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:24.011033 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-85d4f512-3267-4930-b928-3c53afd223bb tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:24.011468 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-85d4f512-3267-4930-b928-3c53afd223bb tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:24.012155 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-85d4f512-3267-4930-b928-3c53afd223bb tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:24.012631 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-85d4f512-3267-4930-b928-3c53afd223bb tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:24.013445 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-85d4f512-3267-4930-b928-3c53afd223bb tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:24.145133 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-85d4f512-3267-4930-b928-3c53afd223bb tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:24.152421 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-85d4f512-3267-4930-b928-3c53afd223bb tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.152228 Aug 05 20:08:24.153004 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 302/579] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:23 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:24.238029 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-8870035c-b700-41ff-97f1-c63a559ec3e3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:24.238639 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-8870035c-b700-41ff-97f1-c63a559ec3e3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:24.244516 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8870035c-b700-41ff-97f1-c63a559ec3e3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:24.245025 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8870035c-b700-41ff-97f1-c63a559ec3e3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:24.245457 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8870035c-b700-41ff-97f1-c63a559ec3e3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:24.246135 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8870035c-b700-41ff-97f1-c63a559ec3e3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:24.246579 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8870035c-b700-41ff-97f1-c63a559ec3e3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:24.246996 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8870035c-b700-41ff-97f1-c63a559ec3e3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:24.308056 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8870035c-b700-41ff-97f1-c63a559ec3e3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:24.315620 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-8870035c-b700-41ff-97f1-c63a559ec3e3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1244 microversion: 2.1 time: 0.081431 Aug 05 20:08:24.316615 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 278/580] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:24 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:24.626011 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-1e9b2cf4-6e49-4ea0-b103-a337525066b8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:24.626582 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-1e9b2cf4-6e49-4ea0-b103-a337525066b8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:24.632471 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1e9b2cf4-6e49-4ea0-b103-a337525066b8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:24.633000 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1e9b2cf4-6e49-4ea0-b103-a337525066b8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:24.633440 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1e9b2cf4-6e49-4ea0-b103-a337525066b8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:24.634136 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1e9b2cf4-6e49-4ea0-b103-a337525066b8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:24.634594 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1e9b2cf4-6e49-4ea0-b103-a337525066b8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:24.635023 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1e9b2cf4-6e49-4ea0-b103-a337525066b8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:24.768523 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-1e9b2cf4-6e49-4ea0-b103-a337525066b8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:24.776015 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-1e9b2cf4-6e49-4ea0-b103-a337525066b8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1513 microversion: 2.1 time: 0.154619 Aug 05 20:08:24.776584 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 303/581] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:24 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:25.173949 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-df94726b-8b05-481c-a7a8-b141d2e9820d tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:25.174564 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-df94726b-8b05-481c-a7a8-b141d2e9820d tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:25.180982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-df94726b-8b05-481c-a7a8-b141d2e9820d tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:25.181473 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-df94726b-8b05-481c-a7a8-b141d2e9820d tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:25.181906 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-df94726b-8b05-481c-a7a8-b141d2e9820d tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:25.182656 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-df94726b-8b05-481c-a7a8-b141d2e9820d tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:25.183112 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-df94726b-8b05-481c-a7a8-b141d2e9820d tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:25.183536 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-df94726b-8b05-481c-a7a8-b141d2e9820d tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:25.315961 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-df94726b-8b05-481c-a7a8-b141d2e9820d tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:25.323357 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-df94726b-8b05-481c-a7a8-b141d2e9820d tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.153892 Aug 05 20:08:25.323917 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 279/582] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:25 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:25.338056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-c5950284-b7f8-4a93-ac6d-4907b47d78ad tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:25.339168 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-c5950284-b7f8-4a93-ac6d-4907b47d78ad tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:25.345919 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c5950284-b7f8-4a93-ac6d-4907b47d78ad tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:25.346416 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c5950284-b7f8-4a93-ac6d-4907b47d78ad tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:25.346884 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c5950284-b7f8-4a93-ac6d-4907b47d78ad tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:25.347592 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c5950284-b7f8-4a93-ac6d-4907b47d78ad tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:25.348048 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c5950284-b7f8-4a93-ac6d-4907b47d78ad tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:25.348482 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c5950284-b7f8-4a93-ac6d-4907b47d78ad tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:25.410510 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-c5950284-b7f8-4a93-ac6d-4907b47d78ad tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:25.417759 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-c5950284-b7f8-4a93-ac6d-4907b47d78ad tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1244 microversion: 2.1 time: 0.083765 Aug 05 20:08:25.418313 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 304/583] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:25 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:25.797465 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-ee9e7e20-afb6-4b1a-a76e-dfc3dc40bca8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:25.798067 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-ee9e7e20-afb6-4b1a-a76e-dfc3dc40bca8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:25.804052 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ee9e7e20-afb6-4b1a-a76e-dfc3dc40bca8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:25.804533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ee9e7e20-afb6-4b1a-a76e-dfc3dc40bca8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:25.804998 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ee9e7e20-afb6-4b1a-a76e-dfc3dc40bca8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:25.805685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ee9e7e20-afb6-4b1a-a76e-dfc3dc40bca8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:25.806142 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ee9e7e20-afb6-4b1a-a76e-dfc3dc40bca8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:25.806563 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ee9e7e20-afb6-4b1a-a76e-dfc3dc40bca8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:25.934045 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-ee9e7e20-afb6-4b1a-a76e-dfc3dc40bca8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:25.941488 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-ee9e7e20-afb6-4b1a-a76e-dfc3dc40bca8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1513 microversion: 2.1 time: 0.147943 Aug 05 20:08:25.942051 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 280/584] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:25 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:26.343623 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-452471ef-2538-47f1-89c1-d55c55e5b044 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:26.344261 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-452471ef-2538-47f1-89c1-d55c55e5b044 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:26.350611 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-452471ef-2538-47f1-89c1-d55c55e5b044 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:26.351087 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-452471ef-2538-47f1-89c1-d55c55e5b044 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:26.351516 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-452471ef-2538-47f1-89c1-d55c55e5b044 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:26.352189 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-452471ef-2538-47f1-89c1-d55c55e5b044 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:26.352660 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-452471ef-2538-47f1-89c1-d55c55e5b044 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:26.353075 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-452471ef-2538-47f1-89c1-d55c55e5b044 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:26.439522 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-2dc8ffcc-63d3-4d4c-9ea0-4ccefedc99c1 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:26.440138 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-2dc8ffcc-63d3-4d4c-9ea0-4ccefedc99c1 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:26.446662 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2dc8ffcc-63d3-4d4c-9ea0-4ccefedc99c1 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:26.447158 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2dc8ffcc-63d3-4d4c-9ea0-4ccefedc99c1 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:26.447594 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2dc8ffcc-63d3-4d4c-9ea0-4ccefedc99c1 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:26.448291 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2dc8ffcc-63d3-4d4c-9ea0-4ccefedc99c1 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:26.448771 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2dc8ffcc-63d3-4d4c-9ea0-4ccefedc99c1 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:26.449201 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2dc8ffcc-63d3-4d4c-9ea0-4ccefedc99c1 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:26.483317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-452471ef-2538-47f1-89c1-d55c55e5b044 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:26.490804 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-452471ef-2538-47f1-89c1-d55c55e5b044 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.151020 Aug 05 20:08:26.491456 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 305/585] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:26 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:26.511200 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-2dc8ffcc-63d3-4d4c-9ea0-4ccefedc99c1 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:26.519535 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-2dc8ffcc-63d3-4d4c-9ea0-4ccefedc99c1 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1244 microversion: 2.1 time: 0.084341 Aug 05 20:08:26.520100 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 281/586] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:26 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:26.962456 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-51ff0e48-9ddd-436c-a82e-50afd25d1953 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:26.963059 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-51ff0e48-9ddd-436c-a82e-50afd25d1953 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:26.969057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-51ff0e48-9ddd-436c-a82e-50afd25d1953 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:26.969536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-51ff0e48-9ddd-436c-a82e-50afd25d1953 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:26.969966 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-51ff0e48-9ddd-436c-a82e-50afd25d1953 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:26.970689 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-51ff0e48-9ddd-436c-a82e-50afd25d1953 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:26.971178 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-51ff0e48-9ddd-436c-a82e-50afd25d1953 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:26.971599 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-51ff0e48-9ddd-436c-a82e-50afd25d1953 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:27.101406 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-51ff0e48-9ddd-436c-a82e-50afd25d1953 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:27.108893 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-51ff0e48-9ddd-436c-a82e-50afd25d1953 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1513 microversion: 2.1 time: 0.150220 Aug 05 20:08:27.109480 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 306/587] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:26 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:27.511317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-8cc8f857-29c0-4d9f-b48b-9f8db4699c5a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:27.511921 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-8cc8f857-29c0-4d9f-b48b-9f8db4699c5a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:27.519271 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8cc8f857-29c0-4d9f-b48b-9f8db4699c5a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:27.519751 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8cc8f857-29c0-4d9f-b48b-9f8db4699c5a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:27.520179 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8cc8f857-29c0-4d9f-b48b-9f8db4699c5a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:27.520969 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8cc8f857-29c0-4d9f-b48b-9f8db4699c5a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:27.521415 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8cc8f857-29c0-4d9f-b48b-9f8db4699c5a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:27.521835 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8cc8f857-29c0-4d9f-b48b-9f8db4699c5a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:27.539070 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-56758333-037e-478c-9c8a-0f570655ae4f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:27.540223 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-56758333-037e-478c-9c8a-0f570655ae4f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:27.546159 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-56758333-037e-478c-9c8a-0f570655ae4f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:27.546642 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-56758333-037e-478c-9c8a-0f570655ae4f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:27.547107 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-56758333-037e-478c-9c8a-0f570655ae4f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:27.547802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-56758333-037e-478c-9c8a-0f570655ae4f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:27.548255 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-56758333-037e-478c-9c8a-0f570655ae4f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:27.548702 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-56758333-037e-478c-9c8a-0f570655ae4f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:27.617628 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-56758333-037e-478c-9c8a-0f570655ae4f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:27.625904 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-56758333-037e-478c-9c8a-0f570655ae4f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1244 microversion: 2.1 time: 0.090610 Aug 05 20:08:27.626474 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 307/588] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:27 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:27.675462 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8cc8f857-29c0-4d9f-b48b-9f8db4699c5a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:27.683887 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-8cc8f857-29c0-4d9f-b48b-9f8db4699c5a tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.176386 Aug 05 20:08:27.684475 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 282/589] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:27 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:28.129617 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-f21f0e91-cef3-435c-92ca-c50b4962dbab tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:28.130347 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-f21f0e91-cef3-435c-92ca-c50b4962dbab tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:28.136403 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f21f0e91-cef3-435c-92ca-c50b4962dbab tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:28.136936 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f21f0e91-cef3-435c-92ca-c50b4962dbab tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:28.137382 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f21f0e91-cef3-435c-92ca-c50b4962dbab tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:28.138835 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f21f0e91-cef3-435c-92ca-c50b4962dbab tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:28.139364 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f21f0e91-cef3-435c-92ca-c50b4962dbab tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:28.139862 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f21f0e91-cef3-435c-92ca-c50b4962dbab tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:28.272850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-f21f0e91-cef3-435c-92ca-c50b4962dbab tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:28.280623 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-f21f0e91-cef3-435c-92ca-c50b4962dbab tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1513 microversion: 2.1 time: 0.154871 Aug 05 20:08:28.281180 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 308/590] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:28 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:28.646835 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-96b65f5b-7741-4fd0-bd54-2d72081d4607 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:28.647444 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-96b65f5b-7741-4fd0-bd54-2d72081d4607 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:28.654451 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-96b65f5b-7741-4fd0-bd54-2d72081d4607 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:28.654838 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-96b65f5b-7741-4fd0-bd54-2d72081d4607 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:28.655385 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-96b65f5b-7741-4fd0-bd54-2d72081d4607 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:28.656067 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-96b65f5b-7741-4fd0-bd54-2d72081d4607 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:28.656516 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-96b65f5b-7741-4fd0-bd54-2d72081d4607 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:28.656958 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-96b65f5b-7741-4fd0-bd54-2d72081d4607 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:28.708097 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b42ca2a6-4eb6-4fae-85ab-ca9fcd428b1b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:28.708824 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-b42ca2a6-4eb6-4fae-85ab-ca9fcd428b1b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:28.715556 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b42ca2a6-4eb6-4fae-85ab-ca9fcd428b1b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:28.715905 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b42ca2a6-4eb6-4fae-85ab-ca9fcd428b1b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:28.716414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b42ca2a6-4eb6-4fae-85ab-ca9fcd428b1b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:28.717979 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b42ca2a6-4eb6-4fae-85ab-ca9fcd428b1b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:28.718319 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-96b65f5b-7741-4fd0-bd54-2d72081d4607 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:28.718581 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b42ca2a6-4eb6-4fae-85ab-ca9fcd428b1b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:28.719073 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b42ca2a6-4eb6-4fae-85ab-ca9fcd428b1b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:28.726125 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-96b65f5b-7741-4fd0-bd54-2d72081d4607 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1244 microversion: 2.1 time: 0.083100 Aug 05 20:08:28.726697 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 283/591] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:28 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:28.853399 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-b42ca2a6-4eb6-4fae-85ab-ca9fcd428b1b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:28.857801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:28.863048 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b42ca2a6-4eb6-4fae-85ab-ca9fcd428b1b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1358 microversion: 2.1 time: 0.159997 Aug 05 20:08:28.863617 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 309/592] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:28 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:29.301395 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-24c5a1f4-0ca6-4a0e-a881-9a1ab435a026 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:29.302038 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-24c5a1f4-0ca6-4a0e-a881-9a1ab435a026 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:29.307963 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24c5a1f4-0ca6-4a0e-a881-9a1ab435a026 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:29.308448 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24c5a1f4-0ca6-4a0e-a881-9a1ab435a026 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:29.308920 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24c5a1f4-0ca6-4a0e-a881-9a1ab435a026 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:29.309611 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24c5a1f4-0ca6-4a0e-a881-9a1ab435a026 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:29.310065 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24c5a1f4-0ca6-4a0e-a881-9a1ab435a026 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:29.310681 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24c5a1f4-0ca6-4a0e-a881-9a1ab435a026 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:29.447947 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-24c5a1f4-0ca6-4a0e-a881-9a1ab435a026 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:29.458673 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-24c5a1f4-0ca6-4a0e-a881-9a1ab435a026 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1513 microversion: 2.1 time: 0.161423 Aug 05 20:08:29.459652 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 284/593] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:29 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:29.748060 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-3a23f6fd-45bf-4596-9e64-ac03cd05ab0d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:29.749175 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-3a23f6fd-45bf-4596-9e64-ac03cd05ab0d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:29.760407 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3a23f6fd-45bf-4596-9e64-ac03cd05ab0d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:29.761628 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3a23f6fd-45bf-4596-9e64-ac03cd05ab0d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:29.762331 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3a23f6fd-45bf-4596-9e64-ac03cd05ab0d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:29.765076 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3a23f6fd-45bf-4596-9e64-ac03cd05ab0d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:29.766216 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3a23f6fd-45bf-4596-9e64-ac03cd05ab0d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:29.767091 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3a23f6fd-45bf-4596-9e64-ac03cd05ab0d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:29.843044 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-3a23f6fd-45bf-4596-9e64-ac03cd05ab0d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:29.851618 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-3a23f6fd-45bf-4596-9e64-ac03cd05ab0d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1292 microversion: 2.1 time: 0.108566 Aug 05 20:08:29.852277 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 310/594] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:29 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1292 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:29.884512 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-48095e1a-a9a7-41bc-ba32-f24499e34903 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:29.885223 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-48095e1a-a9a7-41bc-ba32-f24499e34903 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:29.893675 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-48095e1a-a9a7-41bc-ba32-f24499e34903 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:29.894390 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-48095e1a-a9a7-41bc-ba32-f24499e34903 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:29.895014 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-48095e1a-a9a7-41bc-ba32-f24499e34903 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:29.896197 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-48095e1a-a9a7-41bc-ba32-f24499e34903 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:29.897073 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-48095e1a-a9a7-41bc-ba32-f24499e34903 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:29.897661 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-48095e1a-a9a7-41bc-ba32-f24499e34903 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:30.049127 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-48095e1a-a9a7-41bc-ba32-f24499e34903 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:30.056898 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-48095e1a-a9a7-41bc-ba32-f24499e34903 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1548 microversion: 2.1 time: 0.176223 Aug 05 20:08:30.057681 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 285/595] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:29 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1548 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:30.081263 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-64d40966-0e77-44bf-b199-a3b63760cb7b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:30.082098 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-64d40966-0e77-44bf-b199-a3b63760cb7b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:30.089727 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-64d40966-0e77-44bf-b199-a3b63760cb7b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:30.090448 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-64d40966-0e77-44bf-b199-a3b63760cb7b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:30.091182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-64d40966-0e77-44bf-b199-a3b63760cb7b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:30.092791 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-64d40966-0e77-44bf-b199-a3b63760cb7b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:30.093428 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-64d40966-0e77-44bf-b199-a3b63760cb7b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:30.094054 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-64d40966-0e77-44bf-b199-a3b63760cb7b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:30.251296 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-64d40966-0e77-44bf-b199-a3b63760cb7b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:30.264885 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-64d40966-0e77-44bf-b199-a3b63760cb7b tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1548 microversion: 2.1 time: 0.187129 Aug 05 20:08:30.291240 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 311/596] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:30 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1548 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:30.302259 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-63ab22e2-d27d-4b99-9f39-02229d401531 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:30.313636 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-63ab22e2-d27d-4b99-9f39-02229d401531 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:30.315032 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-63ab22e2-d27d-4b99-9f39-02229d401531 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Searching by: {'deleted': False, 'project_id': 'fe26e033d1844e28849ed4de857a7958'} {{(pid=118191) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 05 20:08:30.323051 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-63ab22e2-d27d-4b99-9f39-02229d401531 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:30.323541 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-63ab22e2-d27d-4b99-9f39-02229d401531 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:30.323978 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-63ab22e2-d27d-4b99-9f39-02229d401531 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:30.324725 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-63ab22e2-d27d-4b99-9f39-02229d401531 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:30.325379 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-63ab22e2-d27d-4b99-9f39-02229d401531 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:30.327526 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-63ab22e2-d27d-4b99-9f39-02229d401531 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:30.448226 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.multi_cell_list [None req-63ab22e2-d27d-4b99-9f39-02229d401531 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118191) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 05 20:08:30.480730 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-40ac5b15-e704-47ed-bc19-fcaa17d43f7d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:30.481363 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-40ac5b15-e704-47ed-bc19-fcaa17d43f7d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:30.483824 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:30.490750 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-40ac5b15-e704-47ed-bc19-fcaa17d43f7d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:30.491311 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-40ac5b15-e704-47ed-bc19-fcaa17d43f7d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:30.491786 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-40ac5b15-e704-47ed-bc19-fcaa17d43f7d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:30.492530 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-40ac5b15-e704-47ed-bc19-fcaa17d43f7d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:30.493040 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-40ac5b15-e704-47ed-bc19-fcaa17d43f7d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:30.493491 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-40ac5b15-e704-47ed-bc19-fcaa17d43f7d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:30.593848 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-63ab22e2-d27d-4b99-9f39-02229d401531 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.296068 Aug 05 20:08:30.595158 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 286/597] 10.222.0.39 () {58 vars in 1125 bytes} [Fri Aug 5 20:08:30 2022] GET /compute/v2.1/servers => generated 343 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:08:30.608518 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-528092af-51f2-4f15-b6c8-56b350195096 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:30.609447 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-528092af-51f2-4f15-b6c8-56b350195096 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:30.615677 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-528092af-51f2-4f15-b6c8-56b350195096 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:30.616304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-528092af-51f2-4f15-b6c8-56b350195096 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:30.617474 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-528092af-51f2-4f15-b6c8-56b350195096 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:30.618582 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-528092af-51f2-4f15-b6c8-56b350195096 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:30.619156 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-528092af-51f2-4f15-b6c8-56b350195096 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:30.619709 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-528092af-51f2-4f15-b6c8-56b350195096 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:30.744114 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-40ac5b15-e704-47ed-bc19-fcaa17d43f7d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:30.751878 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-40ac5b15-e704-47ed-bc19-fcaa17d43f7d tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1513 microversion: 2.1 time: 0.275127 Aug 05 20:08:30.765717 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 312/598] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:30 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1513 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:30.847504 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-528092af-51f2-4f15-b6c8-56b350195096 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:30.856127 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-528092af-51f2-4f15-b6c8-56b350195096 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1548 microversion: 2.1 time: 0.252789 Aug 05 20:08:30.856936 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 287/599] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:30 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1548 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:30.876919 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-1acfa102-22ae-4491-b404-a2e60f48d0f7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:30.877629 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-1acfa102-22ae-4491-b404-a2e60f48d0f7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:30.884444 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1acfa102-22ae-4491-b404-a2e60f48d0f7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:30.884980 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1acfa102-22ae-4491-b404-a2e60f48d0f7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:30.885422 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1acfa102-22ae-4491-b404-a2e60f48d0f7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:30.886134 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1acfa102-22ae-4491-b404-a2e60f48d0f7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:30.886593 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1acfa102-22ae-4491-b404-a2e60f48d0f7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:30.887019 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1acfa102-22ae-4491-b404-a2e60f48d0f7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:30.957637 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-1acfa102-22ae-4491-b404-a2e60f48d0f7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:30.968805 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-1acfa102-22ae-4491-b404-a2e60f48d0f7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1292 microversion: 2.1 time: 0.098823 Aug 05 20:08:30.970515 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 313/600] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:30 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1292 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:31.689164 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-ed4e199c-c806-4129-9b23-48f5467b0c94 req-7041c7c0-d50e-441f-8ae6-5481f705c8af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daea58f2-4fe8-42e5-afdb-c0b8d47b963c", "name": "network-vif-deleted", "tag": "dd4c2340-2e4a-4630-b9ee-b8953b613c7a"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:08:31.699209 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-ed4e199c-c806-4129-9b23-48f5467b0c94 req-7041c7c0-d50e-441f-8ae6-5481f705c8af service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:31.699710 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-ed4e199c-c806-4129-9b23-48f5467b0c94 req-7041c7c0-d50e-441f-8ae6-5481f705c8af service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:31.700345 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-ed4e199c-c806-4129-9b23-48f5467b0c94 req-7041c7c0-d50e-441f-8ae6-5481f705c8af service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:31.712748 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-ed4e199c-c806-4129-9b23-48f5467b0c94 req-7041c7c0-d50e-441f-8ae6-5481f705c8af service nova] Creating event network-vif-deleted:dd4c2340-2e4a-4630-b9ee-b8953b613c7a for instance daea58f2-4fe8-42e5-afdb-c0b8d47b963c on hv-cinder-85221 Aug 05 20:08:31.718893 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-ed4e199c-c806-4129-9b23-48f5467b0c94 req-7041c7c0-d50e-441f-8ae6-5481f705c8af service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033708 Aug 05 20:08:31.720109 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 288/601] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:08:31.775766 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-214e8504-de97-43dd-bab3-4b9d9a5822a9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:31.777242 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-214e8504-de97-43dd-bab3-4b9d9a5822a9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:31.786017 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-214e8504-de97-43dd-bab3-4b9d9a5822a9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:31.789242 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-214e8504-de97-43dd-bab3-4b9d9a5822a9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:31.789911 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-214e8504-de97-43dd-bab3-4b9d9a5822a9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:31.790842 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-214e8504-de97-43dd-bab3-4b9d9a5822a9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:31.793726 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-214e8504-de97-43dd-bab3-4b9d9a5822a9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:31.795123 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-214e8504-de97-43dd-bab3-4b9d9a5822a9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:31.871669 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-214e8504-de97-43dd-bab3-4b9d9a5822a9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0a233c84e1413490057c64654abe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5caf50650e45fbb1872e277f56e3b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:31.880789 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-214e8504-de97-43dd-bab3-4b9d9a5822a9 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 200 len: 1471 microversion: 2.1 time: 0.109426 Aug 05 20:08:31.895259 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 314/602] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:31 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 1471 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:31.991402 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3e8a87db-d8c9-4254-af51-7953f5643b17 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:31.992241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-3e8a87db-d8c9-4254-af51-7953f5643b17 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:32.001459 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e8a87db-d8c9-4254-af51-7953f5643b17 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:32.005797 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e8a87db-d8c9-4254-af51-7953f5643b17 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:32.006281 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e8a87db-d8c9-4254-af51-7953f5643b17 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:32.007040 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e8a87db-d8c9-4254-af51-7953f5643b17 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:32.008915 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e8a87db-d8c9-4254-af51-7953f5643b17 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:32.009809 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e8a87db-d8c9-4254-af51-7953f5643b17 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:32.106258 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3e8a87db-d8c9-4254-af51-7953f5643b17 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:32.132228 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3e8a87db-d8c9-4254-af51-7953f5643b17 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1298 microversion: 2.1 time: 0.144028 Aug 05 20:08:32.132884 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 289/603] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:31 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1298 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:32.902812 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ec0a1889-9b30-454f-8e03-f64c478245c8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:32.903898 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-ec0a1889-9b30-454f-8e03-f64c478245c8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] [instance: daea58f2-4fe8-42e5-afdb-c0b8d47b963c] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:32.917413 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ec0a1889-9b30-454f-8e03-f64c478245c8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:32.918166 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ec0a1889-9b30-454f-8e03-f64c478245c8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:32.918795 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ec0a1889-9b30-454f-8e03-f64c478245c8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:32.919977 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ec0a1889-9b30-454f-8e03-f64c478245c8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:32.920669 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ec0a1889-9b30-454f-8e03-f64c478245c8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:32.921111 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ec0a1889-9b30-454f-8e03-f64c478245c8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:32.942341 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-ec0a1889-9b30-454f-8e03-f64c478245c8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] HTTP exception thrown: Instance daea58f2-4fe8-42e5-afdb-c0b8d47b963c could not be found. Aug 05 20:08:32.946118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ec0a1889-9b30-454f-8e03-f64c478245c8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Request method failure captured: Aug 05 20:08:32.946118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c HTTP/1.1 Aug 05 20:08:32.946118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:08:32.946118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:08:32.946118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:08:32.946118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 0 Aug 05 20:08:32.946118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:08:32.946118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:08:32.946118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:08:32.946118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:08:32.946118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XefZUTxiNutf-ql3Lkh3LilSNEfs_JJCt-aCeGY0Fk72I6eBkGr2KMboWBp_Nnv6TkATU78prPNjPnL_AbO2pBJRu6xsTlm4TzC18_4Qk_7rglHfbu5RBZ7SiyxKXUGM6FVs9OO175EDFCz2i_qZiIamaXZgvjLresOZcFILS_iOJQ Aug 05 20:08:32.946118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:08:32.946118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:08:32.946118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:08:32.946118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:08:32.946118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:08:32.946118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:08:32.946118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: 7a5caf50650e45fbb1872e277f56e3b3 Aug 05 20:08:32.946118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-VolumesSnapshotTestJSON-630007995 Aug 05 20:08:32.946118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:08:32.946118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:08:32.947558 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7a5caf50650e45fbb1872e277f56e3b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a5caf50650e45fbb1872e277f56e3b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a5caf50650e45fbb1872e277f56e3b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7a5caf50650e45fbb1872e277f56e3b3", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:08:32.947558 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-VolumesSnapshotTestJSON-630007995 Aug 05 20:08:32.947558 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: 7a5caf50650e45fbb1872e277f56e3b3 Aug 05 20:08:32.947558 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-630007995 Aug 05 20:08:32.947558 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-VolumesSnapshotTestJSON-630007995-project Aug 05 20:08:32.947558 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:08:32.947558 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:08:32.947558 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: ac0a233c84e1413490057c64654abe99 Aug 05 20:08:32.947558 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-VolumesSnapshotTestJSON-630007995-project Aug 05 20:08:32.947558 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: > Aug 05 20:08:32.947558 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Instance daea58f2-4fe8-42e5-afdb-c0b8d47b963c could not be found. Aug 05 20:08:32.947558 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'id': 'daea58f2-4fe8-42e5-afdb-c0b8d47b963c'} Aug 05 20:08:32.948315 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:08:32.948315 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:08:32.948315 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:08:32.948315 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:08:32.948315 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:08:32.948315 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:08:32.948315 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:08:32.948315 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:08:32.948315 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:08:32.948315 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:08:32.948315 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daea58f2-4fe8-42e5-afdb-c0b8d47b963c could not be found. Aug 05 20:08:32.948315 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:08:32.948315 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:08:32.948315 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:08:32.948315 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:08:32.948315 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:08:32.948315 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:08:32.948315 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:08:32.948315 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:08:32.948315 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:08:32.949715 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:08:32.949715 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:08:32.949715 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:08:32.949715 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:08:32.949715 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:08:32.949715 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:08:32.949715 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:08:32.949715 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daea58f2-4fe8-42e5-afdb-c0b8d47b963c could not be found. Aug 05 20:08:32.949715 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:08:32.949715 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:08:32.949715 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:08:32.949715 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:08:32.949715 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:08:32.949715 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:08:32.949715 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:08:32.949715 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:08:32.949715 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daea58f2-4fe8-42e5-afdb-c0b8d47b963c could not be found. Aug 05 20:08:32.949715 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:08:32.954710 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ec0a1889-9b30-454f-8e03-f64c478245c8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] Returning 404 to user: Instance daea58f2-4fe8-42e5-afdb-c0b8d47b963c could not be found. {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:08:32.955826 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-ec0a1889-9b30-454f-8e03-f64c478245c8 tempest-VolumesSnapshotTestJSON-630007995 tempest-VolumesSnapshotTestJSON-630007995-project] 10.222.0.39 "GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c" status: 404 len: 111 microversion: 2.1 time: 0.056940 Aug 05 20:08:32.958676 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 315/604] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:32 2022] GET /compute/v2.1/servers/daea58f2-4fe8-42e5-afdb-c0b8d47b963c => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 20:08:33.159421 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-66d8b379-9fc2-4427-91df-f7b84712797a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:33.166417 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-66d8b379-9fc2-4427-91df-f7b84712797a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:33.171360 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=10 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:33.178927 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-66d8b379-9fc2-4427-91df-f7b84712797a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:33.179886 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-66d8b379-9fc2-4427-91df-f7b84712797a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:33.180616 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-66d8b379-9fc2-4427-91df-f7b84712797a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:33.182009 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-66d8b379-9fc2-4427-91df-f7b84712797a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:33.182344 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-66d8b379-9fc2-4427-91df-f7b84712797a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:33.183196 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-66d8b379-9fc2-4427-91df-f7b84712797a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:33.432886 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-66d8b379-9fc2-4427-91df-f7b84712797a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:33.439354 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-66d8b379-9fc2-4427-91df-f7b84712797a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1365 microversion: 2.1 time: 0.283618 Aug 05 20:08:33.445234 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 290/605] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:33 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1365 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:33.598749 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell0:SELECT=2 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:33.715382 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-56d91f48-624e-42fb-9984-b5247d13abb7 req-d62e1338-77fd-49ff-a622-0b8de45c3789 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c68719b-222e-48b2-9ce7-55ed27758263", "tag": "89f7c436-de82-4f40-b012-4d72c8fefa77"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:08:33.734991 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-2aa33140-c149-4aa8-8652-e6e1a9746db3 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d8cf1aa-110d-434a-8f2c-48c1f4a048de"}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:08:33.736457 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-56d91f48-624e-42fb-9984-b5247d13abb7 req-d62e1338-77fd-49ff-a622-0b8de45c3789 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:33.736992 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-56d91f48-624e-42fb-9984-b5247d13abb7 req-d62e1338-77fd-49ff-a622-0b8de45c3789 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:33.738528 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-56d91f48-624e-42fb-9984-b5247d13abb7 req-d62e1338-77fd-49ff-a622-0b8de45c3789 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:33.739276 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-2aa33140-c149-4aa8-8652-e6e1a9746db3 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:33.746595 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2aa33140-c149-4aa8-8652-e6e1a9746db3 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:33.748089 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2aa33140-c149-4aa8-8652-e6e1a9746db3 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:33.749103 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2aa33140-c149-4aa8-8652-e6e1a9746db3 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:33.750062 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2aa33140-c149-4aa8-8652-e6e1a9746db3 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:33.750748 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2aa33140-c149-4aa8-8652-e6e1a9746db3 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:33.751388 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2aa33140-c149-4aa8-8652-e6e1a9746db3 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:33.756378 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-56d91f48-624e-42fb-9984-b5247d13abb7 req-d62e1338-77fd-49ff-a622-0b8de45c3789 service nova] Creating event network-changed:89f7c436-de82-4f40-b012-4d72c8fefa77 for instance 2c68719b-222e-48b2-9ce7-55ed27758263 on hv-cinder-85221 Aug 05 20:08:33.761935 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-56d91f48-624e-42fb-9984-b5247d13abb7 req-d62e1338-77fd-49ff-a622-0b8de45c3789 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167541 Aug 05 20:08:33.762713 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 316/606] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:08:34.108676 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-2aa33140-c149-4aa8-8652-e6e1a9746db3 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "POST /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.377891 Aug 05 20:08:34.109746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 291/607] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Aug 5 20:08:33 2022] POST /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760/os-volume_attachments => generated 194 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:08:34.470691 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-155da315-186e-4b46-a258-1060ce660d91 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:34.471564 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-155da315-186e-4b46-a258-1060ce660d91 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:34.480610 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-155da315-186e-4b46-a258-1060ce660d91 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:34.482356 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-155da315-186e-4b46-a258-1060ce660d91 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:34.482976 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-155da315-186e-4b46-a258-1060ce660d91 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:34.483802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-155da315-186e-4b46-a258-1060ce660d91 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:34.484332 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-155da315-186e-4b46-a258-1060ce660d91 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:34.484866 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-155da315-186e-4b46-a258-1060ce660d91 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:34.625794 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-155da315-186e-4b46-a258-1060ce660d91 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:34.633666 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-155da315-186e-4b46-a258-1060ce660d91 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1365 microversion: 2.1 time: 0.168157 Aug 05 20:08:34.634493 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 317/608] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:34 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:08:35.660127 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f32cd602-e973-4ddf-b9a7-908ca044f473 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:35.661607 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f32cd602-e973-4ddf-b9a7-908ca044f473 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:35.671093 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f32cd602-e973-4ddf-b9a7-908ca044f473 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:35.672031 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f32cd602-e973-4ddf-b9a7-908ca044f473 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:35.672730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f32cd602-e973-4ddf-b9a7-908ca044f473 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:35.673482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f32cd602-e973-4ddf-b9a7-908ca044f473 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:35.674005 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f32cd602-e973-4ddf-b9a7-908ca044f473 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:35.674690 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f32cd602-e973-4ddf-b9a7-908ca044f473 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:35.863635 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f32cd602-e973-4ddf-b9a7-908ca044f473 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:35.867676 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:35.875264 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f32cd602-e973-4ddf-b9a7-908ca044f473 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1365 microversion: 2.1 time: 0.222951 Aug 05 20:08:35.875928 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 292/609] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:35 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:36.896735 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-c387801e-d16b-4d30-b335-69b27b86b5b4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:36.897832 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-c387801e-d16b-4d30-b335-69b27b86b5b4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:36.904858 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c387801e-d16b-4d30-b335-69b27b86b5b4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:36.905433 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c387801e-d16b-4d30-b335-69b27b86b5b4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:36.905944 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c387801e-d16b-4d30-b335-69b27b86b5b4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:36.906780 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c387801e-d16b-4d30-b335-69b27b86b5b4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:36.907245 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c387801e-d16b-4d30-b335-69b27b86b5b4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:36.907740 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c387801e-d16b-4d30-b335-69b27b86b5b4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:37.062747 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-c387801e-d16b-4d30-b335-69b27b86b5b4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:37.076691 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-c387801e-d16b-4d30-b335-69b27b86b5b4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1365 microversion: 2.1 time: 0.183358 Aug 05 20:08:37.079143 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 318/610] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:36 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:38.105788 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-4218213c-09be-41ca-8d6d-9de8670b7d0c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:38.109717 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-4218213c-09be-41ca-8d6d-9de8670b7d0c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:38.125806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:38.132804 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4218213c-09be-41ca-8d6d-9de8670b7d0c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:38.134018 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4218213c-09be-41ca-8d6d-9de8670b7d0c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:38.134709 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4218213c-09be-41ca-8d6d-9de8670b7d0c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:38.135633 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4218213c-09be-41ca-8d6d-9de8670b7d0c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:38.136254 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4218213c-09be-41ca-8d6d-9de8670b7d0c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:38.137143 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4218213c-09be-41ca-8d6d-9de8670b7d0c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:38.292395 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-4218213c-09be-41ca-8d6d-9de8670b7d0c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:38.301484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-4218213c-09be-41ca-8d6d-9de8670b7d0c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1365 microversion: 2.1 time: 0.199654 Aug 05 20:08:38.302068 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 293/611] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:38 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:39.323932 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-68f0ac1f-ce47-4b2b-8c05-f9bdc21183b4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:39.324733 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-68f0ac1f-ce47-4b2b-8c05-f9bdc21183b4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:39.332892 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-68f0ac1f-ce47-4b2b-8c05-f9bdc21183b4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:39.333384 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-68f0ac1f-ce47-4b2b-8c05-f9bdc21183b4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:39.333842 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-68f0ac1f-ce47-4b2b-8c05-f9bdc21183b4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:39.334562 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-68f0ac1f-ce47-4b2b-8c05-f9bdc21183b4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:39.335015 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-68f0ac1f-ce47-4b2b-8c05-f9bdc21183b4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:39.335433 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-68f0ac1f-ce47-4b2b-8c05-f9bdc21183b4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:39.482566 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-68f0ac1f-ce47-4b2b-8c05-f9bdc21183b4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:39.500313 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-68f0ac1f-ce47-4b2b-8c05-f9bdc21183b4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1365 microversion: 2.1 time: 0.177690 Aug 05 20:08:39.503743 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 319/612] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:39 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:40.521588 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-aa48f72b-db52-4851-9214-83f9010afcac tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:40.523842 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-aa48f72b-db52-4851-9214-83f9010afcac tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:40.527284 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=4 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:40.535572 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-aa48f72b-db52-4851-9214-83f9010afcac tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:40.536212 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-aa48f72b-db52-4851-9214-83f9010afcac tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:40.536782 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-aa48f72b-db52-4851-9214-83f9010afcac tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:40.537732 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-aa48f72b-db52-4851-9214-83f9010afcac tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:40.538189 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-aa48f72b-db52-4851-9214-83f9010afcac tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:40.538740 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-aa48f72b-db52-4851-9214-83f9010afcac tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:40.761329 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-aa48f72b-db52-4851-9214-83f9010afcac tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:40.775187 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-aa48f72b-db52-4851-9214-83f9010afcac tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1365 microversion: 2.1 time: 0.258242 Aug 05 20:08:40.776358 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 294/613] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:40 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:41.798703 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-014f3350-afb9-4bec-a269-f3338fac61ac tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:41.799380 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-014f3350-afb9-4bec-a269-f3338fac61ac tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:41.806692 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-014f3350-afb9-4bec-a269-f3338fac61ac tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:41.807327 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-014f3350-afb9-4bec-a269-f3338fac61ac tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:41.807867 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-014f3350-afb9-4bec-a269-f3338fac61ac tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:41.808864 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-014f3350-afb9-4bec-a269-f3338fac61ac tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:41.810003 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-014f3350-afb9-4bec-a269-f3338fac61ac tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:41.810448 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-014f3350-afb9-4bec-a269-f3338fac61ac tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:41.954795 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-014f3350-afb9-4bec-a269-f3338fac61ac tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:41.963566 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-014f3350-afb9-4bec-a269-f3338fac61ac tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1365 microversion: 2.1 time: 0.168705 Aug 05 20:08:41.964470 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 320/614] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:41 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:42.988890 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-99cf5be0-ef78-4cd3-b8e5-3fc11ca672b3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:42.989783 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-99cf5be0-ef78-4cd3-b8e5-3fc11ca672b3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:43.002287 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-99cf5be0-ef78-4cd3-b8e5-3fc11ca672b3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:43.002921 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-99cf5be0-ef78-4cd3-b8e5-3fc11ca672b3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:43.003408 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-99cf5be0-ef78-4cd3-b8e5-3fc11ca672b3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:43.010999 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-99cf5be0-ef78-4cd3-b8e5-3fc11ca672b3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:43.011810 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-99cf5be0-ef78-4cd3-b8e5-3fc11ca672b3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:43.012399 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-99cf5be0-ef78-4cd3-b8e5-3fc11ca672b3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:43.229822 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-99cf5be0-ef78-4cd3-b8e5-3fc11ca672b3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:43.240843 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-99cf5be0-ef78-4cd3-b8e5-3fc11ca672b3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1365 microversion: 2.1 time: 0.257540 Aug 05 20:08:43.256108 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 295/615] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:42 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:44.263868 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-92add373-682b-441c-bb67-ae260e1eed63 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:44.264526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-92add373-682b-441c-bb67-ae260e1eed63 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:44.271288 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-92add373-682b-441c-bb67-ae260e1eed63 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:44.271777 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-92add373-682b-441c-bb67-ae260e1eed63 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:44.272224 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-92add373-682b-441c-bb67-ae260e1eed63 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:44.272974 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-92add373-682b-441c-bb67-ae260e1eed63 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:44.273435 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-92add373-682b-441c-bb67-ae260e1eed63 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:44.273896 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-92add373-682b-441c-bb67-ae260e1eed63 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:44.405855 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-92add373-682b-441c-bb67-ae260e1eed63 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:44.413236 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-92add373-682b-441c-bb67-ae260e1eed63 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1365 microversion: 2.1 time: 0.153949 Aug 05 20:08:44.413873 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 321/616] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:44 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:45.435395 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-49359d51-aa15-43d4-bb0f-a5ae4d241013 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:45.436963 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-49359d51-aa15-43d4-bb0f-a5ae4d241013 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:45.443951 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-49359d51-aa15-43d4-bb0f-a5ae4d241013 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:45.444561 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-49359d51-aa15-43d4-bb0f-a5ae4d241013 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:45.445094 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-49359d51-aa15-43d4-bb0f-a5ae4d241013 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:45.446036 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-49359d51-aa15-43d4-bb0f-a5ae4d241013 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:45.446687 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-49359d51-aa15-43d4-bb0f-a5ae4d241013 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:45.447429 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-49359d51-aa15-43d4-bb0f-a5ae4d241013 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:45.606821 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-49359d51-aa15-43d4-bb0f-a5ae4d241013 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:45.615491 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-49359d51-aa15-43d4-bb0f-a5ae4d241013 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1365 microversion: 2.1 time: 0.184182 Aug 05 20:08:45.616121 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 296/617] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:45 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:46.603934 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-bfd61e26-9c48-497e-a7a9-bb07c603068d req-851887d2-a4cb-4134-a2fe-53f094330a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c68719b-222e-48b2-9ce7-55ed27758263", "name": "network-vif-plugged", "status": "completed", "tag": "89f7c436-de82-4f40-b012-4d72c8fefa77"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:08:46.631042 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-bfd61e26-9c48-497e-a7a9-bb07c603068d req-851887d2-a4cb-4134-a2fe-53f094330a6b service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:46.637999 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-b5cd60d4-e5b5-41e4-a431-7431e18364cc tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:46.638962 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-b5cd60d4-e5b5-41e4-a431-7431e18364cc tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:46.642991 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-bfd61e26-9c48-497e-a7a9-bb07c603068d req-851887d2-a4cb-4134-a2fe-53f094330a6b service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:46.644071 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-bfd61e26-9c48-497e-a7a9-bb07c603068d req-851887d2-a4cb-4134-a2fe-53f094330a6b service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:46.646758 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b5cd60d4-e5b5-41e4-a431-7431e18364cc tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:46.648462 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b5cd60d4-e5b5-41e4-a431-7431e18364cc tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:46.648948 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b5cd60d4-e5b5-41e4-a431-7431e18364cc tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:46.649892 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b5cd60d4-e5b5-41e4-a431-7431e18364cc tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:46.650359 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b5cd60d4-e5b5-41e4-a431-7431e18364cc tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:46.651322 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b5cd60d4-e5b5-41e4-a431-7431e18364cc tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:46.658418 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-bfd61e26-9c48-497e-a7a9-bb07c603068d req-851887d2-a4cb-4134-a2fe-53f094330a6b service nova] Creating event network-vif-plugged:89f7c436-de82-4f40-b012-4d72c8fefa77 for instance 2c68719b-222e-48b2-9ce7-55ed27758263 on hv-cinder-85221 Aug 05 20:08:46.664860 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-bfd61e26-9c48-497e-a7a9-bb07c603068d req-851887d2-a4cb-4134-a2fe-53f094330a6b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130397 Aug 05 20:08:46.666338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 322/618] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:08:46.834125 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-b5cd60d4-e5b5-41e4-a431-7431e18364cc tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:46.844258 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-b5cd60d4-e5b5-41e4-a431-7431e18364cc tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1365 microversion: 2.1 time: 0.210411 Aug 05 20:08:46.856743 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 297/619] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:46 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:47.869261 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-dab65649-9a5c-4b3d-b712-d5b88b0f98a3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:47.869957 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-dab65649-9a5c-4b3d-b712-d5b88b0f98a3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:47.876540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dab65649-9a5c-4b3d-b712-d5b88b0f98a3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:47.877061 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dab65649-9a5c-4b3d-b712-d5b88b0f98a3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:47.877565 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dab65649-9a5c-4b3d-b712-d5b88b0f98a3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:47.878287 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dab65649-9a5c-4b3d-b712-d5b88b0f98a3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:47.878770 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dab65649-9a5c-4b3d-b712-d5b88b0f98a3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:47.879194 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dab65649-9a5c-4b3d-b712-d5b88b0f98a3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:48.018788 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-dab65649-9a5c-4b3d-b712-d5b88b0f98a3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:48.026603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-dab65649-9a5c-4b3d-b712-d5b88b0f98a3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1365 microversion: 2.1 time: 0.162116 Aug 05 20:08:48.027202 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 323/620] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:47 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:49.047543 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e081c4e8-1524-450b-ab66-d2a3abade088 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:49.048193 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e081c4e8-1524-450b-ab66-d2a3abade088 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:49.054568 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e081c4e8-1524-450b-ab66-d2a3abade088 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:49.055045 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e081c4e8-1524-450b-ab66-d2a3abade088 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:49.055475 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e081c4e8-1524-450b-ab66-d2a3abade088 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:49.056157 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e081c4e8-1524-450b-ab66-d2a3abade088 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:49.056641 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e081c4e8-1524-450b-ab66-d2a3abade088 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:49.057067 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e081c4e8-1524-450b-ab66-d2a3abade088 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:49.189160 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e081c4e8-1524-450b-ab66-d2a3abade088 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:49.196337 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e081c4e8-1524-450b-ab66-d2a3abade088 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1365 microversion: 2.1 time: 0.152960 Aug 05 20:08:49.197145 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 298/621] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:49 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:50.218125 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-853648d9-5758-48af-8d6c-6ac3016b6026 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:50.218748 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-853648d9-5758-48af-8d6c-6ac3016b6026 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:50.225596 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-853648d9-5758-48af-8d6c-6ac3016b6026 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:50.226445 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-853648d9-5758-48af-8d6c-6ac3016b6026 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:50.226889 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-853648d9-5758-48af-8d6c-6ac3016b6026 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:50.227591 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-853648d9-5758-48af-8d6c-6ac3016b6026 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:50.228049 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-853648d9-5758-48af-8d6c-6ac3016b6026 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:50.228478 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-853648d9-5758-48af-8d6c-6ac3016b6026 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:50.369845 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-853648d9-5758-48af-8d6c-6ac3016b6026 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:50.378524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-853648d9-5758-48af-8d6c-6ac3016b6026 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1365 microversion: 2.1 time: 0.165118 Aug 05 20:08:50.379101 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 324/622] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:50 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:51.401426 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f6dcdc47-2a25-403e-a472-0845235bbe95 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:51.402042 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f6dcdc47-2a25-403e-a472-0845235bbe95 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:51.409463 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f6dcdc47-2a25-403e-a472-0845235bbe95 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:51.409938 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f6dcdc47-2a25-403e-a472-0845235bbe95 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:51.410368 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f6dcdc47-2a25-403e-a472-0845235bbe95 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:51.411056 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f6dcdc47-2a25-403e-a472-0845235bbe95 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:51.411502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f6dcdc47-2a25-403e-a472-0845235bbe95 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:51.411947 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f6dcdc47-2a25-403e-a472-0845235bbe95 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:51.540781 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f6dcdc47-2a25-403e-a472-0845235bbe95 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:51.549035 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f6dcdc47-2a25-403e-a472-0845235bbe95 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1365 microversion: 2.1 time: 0.151473 Aug 05 20:08:51.549593 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 299/623] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:51 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:52.570318 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-692bcebb-7897-4371-9974-8339c9a58378 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:52.570873 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-692bcebb-7897-4371-9974-8339c9a58378 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:52.577944 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-692bcebb-7897-4371-9974-8339c9a58378 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:52.578424 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-692bcebb-7897-4371-9974-8339c9a58378 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:52.578857 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-692bcebb-7897-4371-9974-8339c9a58378 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:52.579537 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-692bcebb-7897-4371-9974-8339c9a58378 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:52.579986 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-692bcebb-7897-4371-9974-8339c9a58378 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:52.580405 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-692bcebb-7897-4371-9974-8339c9a58378 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:52.711094 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-692bcebb-7897-4371-9974-8339c9a58378 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:52.718479 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-692bcebb-7897-4371-9974-8339c9a58378 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1365 microversion: 2.1 time: 0.152152 Aug 05 20:08:52.719036 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 325/624] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:52 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:53.739183 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-34378fff-c12c-4fe0-b1c4-6145b6d9914d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:53.739798 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-34378fff-c12c-4fe0-b1c4-6145b6d9914d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:53.746456 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-34378fff-c12c-4fe0-b1c4-6145b6d9914d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:53.746963 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-34378fff-c12c-4fe0-b1c4-6145b6d9914d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:53.747417 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-34378fff-c12c-4fe0-b1c4-6145b6d9914d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:53.748110 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-34378fff-c12c-4fe0-b1c4-6145b6d9914d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:53.748565 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-34378fff-c12c-4fe0-b1c4-6145b6d9914d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:53.749013 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-34378fff-c12c-4fe0-b1c4-6145b6d9914d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:53.879252 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-34378fff-c12c-4fe0-b1c4-6145b6d9914d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:53.886648 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-34378fff-c12c-4fe0-b1c4-6145b6d9914d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1365 microversion: 2.1 time: 0.151322 Aug 05 20:08:53.887543 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 300/625] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:53 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:54.494245 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-c95c0343-f9d9-4ab0-a879-261c571a6a9c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:54.494739 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-c95c0343-f9d9-4ab0-a879-261c571a6a9c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:54.501702 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c95c0343-f9d9-4ab0-a879-261c571a6a9c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:54.502186 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c95c0343-f9d9-4ab0-a879-261c571a6a9c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:54.502675 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c95c0343-f9d9-4ab0-a879-261c571a6a9c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:54.503305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c95c0343-f9d9-4ab0-a879-261c571a6a9c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:54.503755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c95c0343-f9d9-4ab0-a879-261c571a6a9c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:54.504173 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c95c0343-f9d9-4ab0-a879-261c571a6a9c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:54.528939 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-c95c0343-f9d9-4ab0-a879-261c571a6a9c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb/ips" status: 200 len: 151 microversion: 2.20 time: 0.038546 Aug 05 20:08:54.529489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 326/626] 10.222.0.39 () {60 vars in 1289 bytes} [Fri Aug 5 20:08:54 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:08:54.907906 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-4af9fcf1-35a2-4c31-b2f2-1d104055481f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:54.908649 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-4af9fcf1-35a2-4c31-b2f2-1d104055481f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:54.915007 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4af9fcf1-35a2-4c31-b2f2-1d104055481f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:54.915493 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4af9fcf1-35a2-4c31-b2f2-1d104055481f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:54.915926 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4af9fcf1-35a2-4c31-b2f2-1d104055481f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:54.916641 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4af9fcf1-35a2-4c31-b2f2-1d104055481f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:54.917094 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4af9fcf1-35a2-4c31-b2f2-1d104055481f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:54.917518 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4af9fcf1-35a2-4c31-b2f2-1d104055481f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:55.046810 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-4af9fcf1-35a2-4c31-b2f2-1d104055481f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:55.054415 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-4af9fcf1-35a2-4c31-b2f2-1d104055481f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1555 microversion: 2.1 time: 0.150401 Aug 05 20:08:55.054980 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 301/627] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:54 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:55.075573 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-dd028bad-03de-4748-8bdd-68114f0a480c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:55.076072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-dd028bad-03de-4748-8bdd-68114f0a480c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:55.081910 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dd028bad-03de-4748-8bdd-68114f0a480c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:55.082388 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dd028bad-03de-4748-8bdd-68114f0a480c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:55.082821 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dd028bad-03de-4748-8bdd-68114f0a480c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:55.083505 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dd028bad-03de-4748-8bdd-68114f0a480c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:55.083955 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dd028bad-03de-4748-8bdd-68114f0a480c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:55.084374 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dd028bad-03de-4748-8bdd-68114f0a480c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:55.165240 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-dd028bad-03de-4748-8bdd-68114f0a480c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093699 Aug 05 20:08:55.165831 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 327/628] 10.222.0.39 () {58 vars in 1275 bytes} [Fri Aug 5 20:08:55 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:08:56.122791 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-9cc6aca0-0c3e-45a8-a1fa-55a18dc25808 req-8b318a03-8b02-4340-b783-9795ab05abdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c68719b-222e-48b2-9ce7-55ed27758263", "tag": "89f7c436-de82-4f40-b012-4d72c8fefa77"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:08:56.133099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-9cc6aca0-0c3e-45a8-a1fa-55a18dc25808 req-8b318a03-8b02-4340-b783-9795ab05abdd service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:56.133815 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-9cc6aca0-0c3e-45a8-a1fa-55a18dc25808 req-8b318a03-8b02-4340-b783-9795ab05abdd service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:56.134240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-9cc6aca0-0c3e-45a8-a1fa-55a18dc25808 req-8b318a03-8b02-4340-b783-9795ab05abdd service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:56.146637 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-9cc6aca0-0c3e-45a8-a1fa-55a18dc25808 req-8b318a03-8b02-4340-b783-9795ab05abdd service nova] Creating event network-changed:89f7c436-de82-4f40-b012-4d72c8fefa77 for instance 2c68719b-222e-48b2-9ce7-55ed27758263 on hv-cinder-85221 Aug 05 20:08:56.153916 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-9cc6aca0-0c3e-45a8-a1fa-55a18dc25808 req-8b318a03-8b02-4340-b783-9795ab05abdd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034780 Aug 05 20:08:56.158126 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 302/629] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:08:58.320526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-f2c24e21-aa7c-4d9f-9ede-b710d7e527d0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:08:58.321270 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-f2c24e21-aa7c-4d9f-9ede-b710d7e527d0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:58.327495 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f2c24e21-aa7c-4d9f-9ede-b710d7e527d0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:58.327988 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f2c24e21-aa7c-4d9f-9ede-b710d7e527d0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:58.328427 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f2c24e21-aa7c-4d9f-9ede-b710d7e527d0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:58.329169 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f2c24e21-aa7c-4d9f-9ede-b710d7e527d0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:58.329624 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f2c24e21-aa7c-4d9f-9ede-b710d7e527d0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:58.330479 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f2c24e21-aa7c-4d9f-9ede-b710d7e527d0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:58.354829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.objects.instance [None req-f2c24e21-aa7c-4d9f-9ede-b710d7e527d0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lazy-loading 'flavor' on Instance uuid 98e6fc07-61b1-455d-8bf0-563c5debbebb {{(pid=118192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:08:58.375302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:08:58.537995 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-f2c24e21-aa7c-4d9f-9ede-b710d7e527d0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "POST /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb/action" status: 202 len: 0 microversion: 2.20 time: 0.221870 Aug 05 20:08:58.538582 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 328/630] 10.222.0.39 () {62 vars in 1319 bytes} [Fri Aug 5 20:08:58 2022] POST /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:08:58.548446 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a10cd7be-9aee-4255-bfee-306be94c1aa9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:58.549229 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-a10cd7be-9aee-4255-bfee-306be94c1aa9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:58.555402 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a10cd7be-9aee-4255-bfee-306be94c1aa9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:58.555896 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a10cd7be-9aee-4255-bfee-306be94c1aa9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:58.556413 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a10cd7be-9aee-4255-bfee-306be94c1aa9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:58.557063 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a10cd7be-9aee-4255-bfee-306be94c1aa9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:58.557517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a10cd7be-9aee-4255-bfee-306be94c1aa9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:58.557947 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a10cd7be-9aee-4255-bfee-306be94c1aa9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:58.698198 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a10cd7be-9aee-4255-bfee-306be94c1aa9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:58.706948 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a10cd7be-9aee-4255-bfee-306be94c1aa9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:58.708466 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a10cd7be-9aee-4255-bfee-306be94c1aa9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:58.709722 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-a10cd7be-9aee-4255-bfee-306be94c1aa9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1724 microversion: 2.20 time: 0.166707 Aug 05 20:08:58.710355 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 303/631] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:08:58 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:08:58.869452 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-31c5876b-321b-4401-a4aa-b08bfea03fad tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:58.870378 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-31c5876b-321b-4401-a4aa-b08bfea03fad tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:58.876830 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-31c5876b-321b-4401-a4aa-b08bfea03fad tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:58.877322 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-31c5876b-321b-4401-a4aa-b08bfea03fad tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:58.877787 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-31c5876b-321b-4401-a4aa-b08bfea03fad tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:58.878481 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-31c5876b-321b-4401-a4aa-b08bfea03fad tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:58.878936 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-31c5876b-321b-4401-a4aa-b08bfea03fad tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:58.879365 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-31c5876b-321b-4401-a4aa-b08bfea03fad tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:59.009031 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-31c5876b-321b-4401-a4aa-b08bfea03fad tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:08:59.017853 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-31c5876b-321b-4401-a4aa-b08bfea03fad tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1594 microversion: 2.1 time: 0.152938 Aug 05 20:08:59.018414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 329/632] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:08:58 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1594 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:08:59.734300 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-8590b28b-2690-41bc-b246-9a41fcafc596 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:08:59.734937 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-8590b28b-2690-41bc-b246-9a41fcafc596 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:08:59.740978 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8590b28b-2690-41bc-b246-9a41fcafc596 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:59.741458 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8590b28b-2690-41bc-b246-9a41fcafc596 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:59.741891 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8590b28b-2690-41bc-b246-9a41fcafc596 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:08:59.742572 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8590b28b-2690-41bc-b246-9a41fcafc596 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:08:59.743019 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8590b28b-2690-41bc-b246-9a41fcafc596 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:08:59.743442 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8590b28b-2690-41bc-b246-9a41fcafc596 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:00.222518 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8590b28b-2690-41bc-b246-9a41fcafc596 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:00.230748 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8590b28b-2690-41bc-b246-9a41fcafc596 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:00.233258 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8590b28b-2690-41bc-b246-9a41fcafc596 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:00.234439 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-8590b28b-2690-41bc-b246-9a41fcafc596 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1724 microversion: 2.20 time: 0.504633 Aug 05 20:09:00.235006 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 304/633] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:08:59 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1724 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:01.140236 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-49a7a86f-3a0a-48a3-b028-34ad644453a9 req-65e63392-f4ad-4b69-9ed8-7a85af6e509e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9a46a51-71f3-4aa6-ab85-c4d514de3760", "tag": "543b6e01-d59d-496a-ba4f-c4f68f78dad4"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:01.150095 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=36 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:01.151896 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-49a7a86f-3a0a-48a3-b028-34ad644453a9 req-65e63392-f4ad-4b69-9ed8-7a85af6e509e service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:01.152392 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-49a7a86f-3a0a-48a3-b028-34ad644453a9 req-65e63392-f4ad-4b69-9ed8-7a85af6e509e service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:01.154994 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-49a7a86f-3a0a-48a3-b028-34ad644453a9 req-65e63392-f4ad-4b69-9ed8-7a85af6e509e service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:01.167281 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-49a7a86f-3a0a-48a3-b028-34ad644453a9 req-65e63392-f4ad-4b69-9ed8-7a85af6e509e service nova] Creating event network-changed:543b6e01-d59d-496a-ba4f-c4f68f78dad4 for instance a9a46a51-71f3-4aa6-ab85-c4d514de3760 on hv-cinder-85221 Aug 05 20:09:01.173791 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-49a7a86f-3a0a-48a3-b028-34ad644453a9 req-65e63392-f4ad-4b69-9ed8-7a85af6e509e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038158 Aug 05 20:09:01.177445 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 330/634] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:09:01.258837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-82d5063c-42fc-462d-949d-9ce040d19f79 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:01.259615 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-82d5063c-42fc-462d-949d-9ce040d19f79 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:01.267925 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-82d5063c-42fc-462d-949d-9ce040d19f79 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:01.268411 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-82d5063c-42fc-462d-949d-9ce040d19f79 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:01.268863 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-82d5063c-42fc-462d-949d-9ce040d19f79 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:01.269558 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-82d5063c-42fc-462d-949d-9ce040d19f79 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:01.270030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-82d5063c-42fc-462d-949d-9ce040d19f79 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:01.270458 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-82d5063c-42fc-462d-949d-9ce040d19f79 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:01.425127 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-82d5063c-42fc-462d-949d-9ce040d19f79 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:01.438087 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-82d5063c-42fc-462d-949d-9ce040d19f79 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:01.440210 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-82d5063c-42fc-462d-949d-9ce040d19f79 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:01.441601 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-82d5063c-42fc-462d-949d-9ce040d19f79 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1724 microversion: 2.20 time: 0.187303 Aug 05 20:09:01.442481 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 305/635] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:01 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:02.395612 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-175732b6-8051-4b60-ae3b-13afaac5e084 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1944932153"}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:02.396318 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-175732b6-8051-4b60-ae3b-13afaac5e084 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:02.403341 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-175732b6-8051-4b60-ae3b-13afaac5e084 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:02.404017 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-175732b6-8051-4b60-ae3b-13afaac5e084 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:02.404615 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-175732b6-8051-4b60-ae3b-13afaac5e084 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:02.405364 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-175732b6-8051-4b60-ae3b-13afaac5e084 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:02.405936 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-175732b6-8051-4b60-ae3b-13afaac5e084 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:02.406331 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-175732b6-8051-4b60-ae3b-13afaac5e084 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:02.464922 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-39ad27dd-74b0-4b61-a556-c68a132dfbfc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:02.466174 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-39ad27dd-74b0-4b61-a556-c68a132dfbfc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:02.472850 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-39ad27dd-74b0-4b61-a556-c68a132dfbfc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:02.473341 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-39ad27dd-74b0-4b61-a556-c68a132dfbfc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:02.473813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-39ad27dd-74b0-4b61-a556-c68a132dfbfc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:02.474470 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-39ad27dd-74b0-4b61-a556-c68a132dfbfc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:02.474919 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-39ad27dd-74b0-4b61-a556-c68a132dfbfc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:02.475341 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-39ad27dd-74b0-4b61-a556-c68a132dfbfc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:02.563024 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.network.security_group_api [None req-175732b6-8051-4b60-ae3b-13afaac5e084 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Adding security group 23ad4f90-c228-4466-9200-3e3e9a8e73eb to port 543b6e01-d59d-496a-ba4f-c4f68f78dad4 Aug 05 20:09:02.693452 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-39ad27dd-74b0-4b61-a556-c68a132dfbfc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:02.701762 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-39ad27dd-74b0-4b61-a556-c68a132dfbfc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:02.703282 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-39ad27dd-74b0-4b61-a556-c68a132dfbfc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:02.704442 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-39ad27dd-74b0-4b61-a556-c68a132dfbfc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1724 microversion: 2.20 time: 0.243463 Aug 05 20:09:02.705030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 306/636] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:02 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:02.918172 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-175732b6-8051-4b60-ae3b-13afaac5e084 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "POST /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760/action" status: 202 len: 0 microversion: 2.1 time: 0.527397 Aug 05 20:09:02.919324 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 331/637] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Aug 5 20:09:02 2022] POST /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 20:09:02.927563 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-6f56138b-d1f7-4655-9e38-5d921f43803f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:02.928171 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-6f56138b-d1f7-4655-9e38-5d921f43803f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:02.934014 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6f56138b-d1f7-4655-9e38-5d921f43803f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:02.934660 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6f56138b-d1f7-4655-9e38-5d921f43803f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:02.935197 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6f56138b-d1f7-4655-9e38-5d921f43803f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:02.935880 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6f56138b-d1f7-4655-9e38-5d921f43803f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:02.936336 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6f56138b-d1f7-4655-9e38-5d921f43803f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:02.936843 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6f56138b-d1f7-4655-9e38-5d921f43803f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:03.108930 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-6f56138b-d1f7-4655-9e38-5d921f43803f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:03.118298 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-6f56138b-d1f7-4655-9e38-5d921f43803f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1760 microversion: 2.1 time: 0.194262 Aug 05 20:09:03.119198 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 307/638] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:02 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1760 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:03.188314 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-babe7d20-ac9d-4e66-9cd7-b9a3401a6326 req-a25f0669-0648-4cb3-87c8-51750a72d229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9a46a51-71f3-4aa6-ab85-c4d514de3760", "tag": "543b6e01-d59d-496a-ba4f-c4f68f78dad4"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:03.198476 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-babe7d20-ac9d-4e66-9cd7-b9a3401a6326 req-a25f0669-0648-4cb3-87c8-51750a72d229 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:03.198997 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-babe7d20-ac9d-4e66-9cd7-b9a3401a6326 req-a25f0669-0648-4cb3-87c8-51750a72d229 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:03.199561 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-babe7d20-ac9d-4e66-9cd7-b9a3401a6326 req-a25f0669-0648-4cb3-87c8-51750a72d229 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:03.213089 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-babe7d20-ac9d-4e66-9cd7-b9a3401a6326 req-a25f0669-0648-4cb3-87c8-51750a72d229 service nova] Creating event network-changed:543b6e01-d59d-496a-ba4f-c4f68f78dad4 for instance a9a46a51-71f3-4aa6-ab85-c4d514de3760 on hv-cinder-85221 Aug 05 20:09:03.219235 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-babe7d20-ac9d-4e66-9cd7-b9a3401a6326 req-a25f0669-0648-4cb3-87c8-51750a72d229 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034870 Aug 05 20:09:03.220228 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 332/639] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:09:03.727997 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-031d3a19-b27c-4212-a0d8-e665e0cd2596 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:03.729311 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-031d3a19-b27c-4212-a0d8-e665e0cd2596 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:03.735784 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-031d3a19-b27c-4212-a0d8-e665e0cd2596 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:03.736326 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-031d3a19-b27c-4212-a0d8-e665e0cd2596 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:03.736786 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-031d3a19-b27c-4212-a0d8-e665e0cd2596 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:03.737483 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-031d3a19-b27c-4212-a0d8-e665e0cd2596 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:03.738123 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-031d3a19-b27c-4212-a0d8-e665e0cd2596 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:03.738547 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-031d3a19-b27c-4212-a0d8-e665e0cd2596 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:03.871828 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-031d3a19-b27c-4212-a0d8-e665e0cd2596 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:03.879941 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-031d3a19-b27c-4212-a0d8-e665e0cd2596 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:03.881477 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-031d3a19-b27c-4212-a0d8-e665e0cd2596 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:03.882641 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-031d3a19-b27c-4212-a0d8-e665e0cd2596 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1724 microversion: 2.20 time: 0.159065 Aug 05 20:09:03.883208 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 308/640] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:03 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:04.907844 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-1075b67d-36b4-4f60-b010-a4d368658f14 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:04.908528 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-1075b67d-36b4-4f60-b010-a4d368658f14 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:04.915096 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1075b67d-36b4-4f60-b010-a4d368658f14 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:04.915590 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1075b67d-36b4-4f60-b010-a4d368658f14 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:04.916000 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1075b67d-36b4-4f60-b010-a4d368658f14 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:04.916720 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1075b67d-36b4-4f60-b010-a4d368658f14 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:04.917172 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1075b67d-36b4-4f60-b010-a4d368658f14 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:04.917588 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1075b67d-36b4-4f60-b010-a4d368658f14 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:05.047433 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-1075b67d-36b4-4f60-b010-a4d368658f14 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:05.055282 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-1075b67d-36b4-4f60-b010-a4d368658f14 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:05.056960 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-1075b67d-36b4-4f60-b010-a4d368658f14 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:05.058057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-1075b67d-36b4-4f60-b010-a4d368658f14 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1724 microversion: 2.20 time: 0.155526 Aug 05 20:09:05.058611 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 333/641] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:04 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:09:06.084563 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e338e4fc-65c8-4446-9849-f3da1a151ab0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:06.085471 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e338e4fc-65c8-4446-9849-f3da1a151ab0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:06.092891 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e338e4fc-65c8-4446-9849-f3da1a151ab0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:06.093516 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e338e4fc-65c8-4446-9849-f3da1a151ab0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:06.094060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e338e4fc-65c8-4446-9849-f3da1a151ab0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:06.094870 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e338e4fc-65c8-4446-9849-f3da1a151ab0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:06.095438 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e338e4fc-65c8-4446-9849-f3da1a151ab0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:06.096171 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e338e4fc-65c8-4446-9849-f3da1a151ab0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:06.237409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e338e4fc-65c8-4446-9849-f3da1a151ab0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:06.246069 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e338e4fc-65c8-4446-9849-f3da1a151ab0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:06.247631 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e338e4fc-65c8-4446-9849-f3da1a151ab0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:06.248827 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e338e4fc-65c8-4446-9849-f3da1a151ab0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1724 microversion: 2.20 time: 0.169474 Aug 05 20:09:06.249389 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 309/642] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:06 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:07.271894 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-73897789-e287-45e6-bd76-1678e71d598e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:07.272598 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-73897789-e287-45e6-bd76-1678e71d598e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:07.280560 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-73897789-e287-45e6-bd76-1678e71d598e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:07.281029 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-73897789-e287-45e6-bd76-1678e71d598e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:07.281466 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-73897789-e287-45e6-bd76-1678e71d598e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:07.282167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-73897789-e287-45e6-bd76-1678e71d598e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:07.282653 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-73897789-e287-45e6-bd76-1678e71d598e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:07.283078 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-73897789-e287-45e6-bd76-1678e71d598e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:07.506918 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-73897789-e287-45e6-bd76-1678e71d598e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:07.518053 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-73897789-e287-45e6-bd76-1678e71d598e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:07.519746 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-73897789-e287-45e6-bd76-1678e71d598e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:07.521091 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-73897789-e287-45e6-bd76-1678e71d598e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1724 microversion: 2.20 time: 0.253559 Aug 05 20:09:07.533112 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 334/643] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:07 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:08.546353 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a657f61d-99c4-4bc5-97e6-03cd7c005563 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:08.547054 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-a657f61d-99c4-4bc5-97e6-03cd7c005563 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:08.549776 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=34 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:08.555271 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a657f61d-99c4-4bc5-97e6-03cd7c005563 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:08.555754 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a657f61d-99c4-4bc5-97e6-03cd7c005563 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:08.557961 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a657f61d-99c4-4bc5-97e6-03cd7c005563 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:08.557961 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a657f61d-99c4-4bc5-97e6-03cd7c005563 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:08.564385 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a657f61d-99c4-4bc5-97e6-03cd7c005563 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:08.564939 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a657f61d-99c4-4bc5-97e6-03cd7c005563 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:08.568296 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=99 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:08.751541 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a657f61d-99c4-4bc5-97e6-03cd7c005563 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:08.762667 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a657f61d-99c4-4bc5-97e6-03cd7c005563 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:08.764245 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a657f61d-99c4-4bc5-97e6-03cd7c005563 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:08.765528 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-a657f61d-99c4-4bc5-97e6-03cd7c005563 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1724 microversion: 2.20 time: 0.223574 Aug 05 20:09:08.766104 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 310/644] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:08 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:09:09.789930 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-c745223a-e78c-4b8d-8ca3-1af58317a87a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:09.790556 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-c745223a-e78c-4b8d-8ca3-1af58317a87a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:09.798724 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c745223a-e78c-4b8d-8ca3-1af58317a87a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:09.799223 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c745223a-e78c-4b8d-8ca3-1af58317a87a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:09.799872 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c745223a-e78c-4b8d-8ca3-1af58317a87a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:09.800821 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c745223a-e78c-4b8d-8ca3-1af58317a87a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:09.801300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c745223a-e78c-4b8d-8ca3-1af58317a87a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:09.801729 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c745223a-e78c-4b8d-8ca3-1af58317a87a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:10.051356 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-c745223a-e78c-4b8d-8ca3-1af58317a87a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:10.064209 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-c745223a-e78c-4b8d-8ca3-1af58317a87a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:10.068313 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-c745223a-e78c-4b8d-8ca3-1af58317a87a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:10.071920 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-c745223a-e78c-4b8d-8ca3-1af58317a87a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1724 microversion: 2.20 time: 0.286587 Aug 05 20:09:10.073472 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 335/645] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:09 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1724 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:11.103448 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-2b5f1644-834a-4122-8216-7eb361991786 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:11.104652 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-2b5f1644-834a-4122-8216-7eb361991786 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:11.112819 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2b5f1644-834a-4122-8216-7eb361991786 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:11.113322 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2b5f1644-834a-4122-8216-7eb361991786 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:11.113761 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2b5f1644-834a-4122-8216-7eb361991786 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:11.114466 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2b5f1644-834a-4122-8216-7eb361991786 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:11.114923 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2b5f1644-834a-4122-8216-7eb361991786 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:11.115540 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2b5f1644-834a-4122-8216-7eb361991786 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:11.394476 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-2b5f1644-834a-4122-8216-7eb361991786 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:11.405417 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-2b5f1644-834a-4122-8216-7eb361991786 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:11.407429 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-2b5f1644-834a-4122-8216-7eb361991786 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:11.409222 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-2b5f1644-834a-4122-8216-7eb361991786 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1724 microversion: 2.20 time: 0.311697 Aug 05 20:09:11.409989 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 311/646] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:11 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1724 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:12.436680 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-14ab1186-f7da-4edf-b526-51b3ecfa2f54 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:12.437382 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-14ab1186-f7da-4edf-b526-51b3ecfa2f54 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:12.446161 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-14ab1186-f7da-4edf-b526-51b3ecfa2f54 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:12.446780 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-14ab1186-f7da-4edf-b526-51b3ecfa2f54 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:12.447309 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-14ab1186-f7da-4edf-b526-51b3ecfa2f54 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:12.448220 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-14ab1186-f7da-4edf-b526-51b3ecfa2f54 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:12.449477 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-14ab1186-f7da-4edf-b526-51b3ecfa2f54 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:12.450211 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-14ab1186-f7da-4edf-b526-51b3ecfa2f54 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:12.588060 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-14ab1186-f7da-4edf-b526-51b3ecfa2f54 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:12.597508 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-14ab1186-f7da-4edf-b526-51b3ecfa2f54 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:12.599008 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-14ab1186-f7da-4edf-b526-51b3ecfa2f54 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:12.600717 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-14ab1186-f7da-4edf-b526-51b3ecfa2f54 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1724 microversion: 2.20 time: 0.169351 Aug 05 20:09:12.601462 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 336/647] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:12 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:13.625668 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-44394c84-6ba9-4b37-b1ab-bdd6baa57197 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:13.633035 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-44394c84-6ba9-4b37-b1ab-bdd6baa57197 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:13.643979 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-44394c84-6ba9-4b37-b1ab-bdd6baa57197 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:13.645122 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-44394c84-6ba9-4b37-b1ab-bdd6baa57197 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:13.645883 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-44394c84-6ba9-4b37-b1ab-bdd6baa57197 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:13.646978 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-44394c84-6ba9-4b37-b1ab-bdd6baa57197 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:13.648194 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-44394c84-6ba9-4b37-b1ab-bdd6baa57197 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:13.649104 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-44394c84-6ba9-4b37-b1ab-bdd6baa57197 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:13.881053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-44394c84-6ba9-4b37-b1ab-bdd6baa57197 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:13.891050 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-44394c84-6ba9-4b37-b1ab-bdd6baa57197 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:13.894988 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-44394c84-6ba9-4b37-b1ab-bdd6baa57197 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:13.896948 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-44394c84-6ba9-4b37-b1ab-bdd6baa57197 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1724 microversion: 2.20 time: 0.277005 Aug 05 20:09:13.908622 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 312/648] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:13 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1724 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:14.923503 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-23262056-dfa8-4dac-a3b1-92bc79734833 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:14.924126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-23262056-dfa8-4dac-a3b1-92bc79734833 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:14.939150 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-23262056-dfa8-4dac-a3b1-92bc79734833 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:14.939650 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-23262056-dfa8-4dac-a3b1-92bc79734833 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:14.940091 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-23262056-dfa8-4dac-a3b1-92bc79734833 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:14.940834 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-23262056-dfa8-4dac-a3b1-92bc79734833 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:14.941291 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-23262056-dfa8-4dac-a3b1-92bc79734833 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:14.941798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-23262056-dfa8-4dac-a3b1-92bc79734833 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:15.178014 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-23262056-dfa8-4dac-a3b1-92bc79734833 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:15.187098 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-23262056-dfa8-4dac-a3b1-92bc79734833 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:15.189031 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-23262056-dfa8-4dac-a3b1-92bc79734833 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:15.190582 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-23262056-dfa8-4dac-a3b1-92bc79734833 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1724 microversion: 2.20 time: 0.274704 Aug 05 20:09:15.193811 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 337/649] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:14 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1724 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:16.219794 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-bad8ab13-316a-41db-831a-66c345f7085f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:16.221144 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-bad8ab13-316a-41db-831a-66c345f7085f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:16.228048 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bad8ab13-316a-41db-831a-66c345f7085f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:16.228925 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bad8ab13-316a-41db-831a-66c345f7085f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:16.229592 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bad8ab13-316a-41db-831a-66c345f7085f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:16.231403 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bad8ab13-316a-41db-831a-66c345f7085f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:16.232086 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bad8ab13-316a-41db-831a-66c345f7085f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:16.233105 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bad8ab13-316a-41db-831a-66c345f7085f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:16.473074 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-bad8ab13-316a-41db-831a-66c345f7085f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:16.483418 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-bad8ab13-316a-41db-831a-66c345f7085f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:16.485087 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-bad8ab13-316a-41db-831a-66c345f7085f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:16.486447 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-bad8ab13-316a-41db-831a-66c345f7085f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1745 microversion: 2.20 time: 0.271703 Aug 05 20:09:16.487192 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 313/650] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:16 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1745 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:16.793707 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-49b45469-e036-4bec-874a-6ba867e3a00f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Action: 'create', calling method: .version_select at 0x7fe3e45481f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1158990661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHur9YSCWbiT4h/kpjbYANBqJ8bWoXB9UiDYnvECc+W2hlFTuHtg7JVmwFH9CrGkEPPZW7SEcW6Bmn4nEBGmehEFcL0ac4UOoSKpVDSZMMZW1HVJszdxVGfLOfqAy78V/g=="}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:16.809359 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-49b45469-e036-4bec-874a-6ba867e3a00f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Getting quotas for project cd1707d3a6c640b78baeb522cfb7ecdb. Resources: {'key_pairs'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:09:16.813492 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-49b45469-e036-4bec-874a-6ba867e3a00f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Getting quotas for user b5d959f3af3745ed8e0bc4a67faf34f1 and project cd1707d3a6c640b78baeb522cfb7ecdb. Resources: {'key_pairs'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:09:16.841652 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-49b45469-e036-4bec-874a-6ba867e3a00f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.237358 Aug 05 20:09:16.842302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 338/651] 10.222.0.39 () {60 vars in 1159 bytes} [Fri Aug 5 20:09:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:09:17.519872 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f4215565-2a22-441c-b563-4c3fccebe35a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:17.522778 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f4215565-2a22-441c-b563-4c3fccebe35a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:17.536863 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f4215565-2a22-441c-b563-4c3fccebe35a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:17.537355 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f4215565-2a22-441c-b563-4c3fccebe35a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:17.537786 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f4215565-2a22-441c-b563-4c3fccebe35a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:17.539233 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f4215565-2a22-441c-b563-4c3fccebe35a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:17.539708 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f4215565-2a22-441c-b563-4c3fccebe35a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:17.540144 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f4215565-2a22-441c-b563-4c3fccebe35a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:17.733138 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f4215565-2a22-441c-b563-4c3fccebe35a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:17.746483 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f4215565-2a22-441c-b563-4c3fccebe35a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:17.748024 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f4215565-2a22-441c-b563-4c3fccebe35a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:17.749274 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f4215565-2a22-441c-b563-4c3fccebe35a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1745 microversion: 2.20 time: 0.240720 Aug 05 20:09:17.750025 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 314/652] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:17 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1745 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:18.773319 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-cbaa38ab-7980-4caf-a0da-7d80ae129f37 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:18.774499 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-cbaa38ab-7980-4caf-a0da-7d80ae129f37 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:18.783098 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cbaa38ab-7980-4caf-a0da-7d80ae129f37 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:18.783819 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cbaa38ab-7980-4caf-a0da-7d80ae129f37 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:18.784532 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cbaa38ab-7980-4caf-a0da-7d80ae129f37 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:18.785678 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cbaa38ab-7980-4caf-a0da-7d80ae129f37 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:18.786364 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cbaa38ab-7980-4caf-a0da-7d80ae129f37 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:18.786834 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cbaa38ab-7980-4caf-a0da-7d80ae129f37 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:18.921475 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-cbaa38ab-7980-4caf-a0da-7d80ae129f37 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:18.930540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-cbaa38ab-7980-4caf-a0da-7d80ae129f37 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:18.932052 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-cbaa38ab-7980-4caf-a0da-7d80ae129f37 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:18.933884 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-cbaa38ab-7980-4caf-a0da-7d80ae129f37 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1745 microversion: 2.20 time: 0.163912 Aug 05 20:09:18.934439 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 339/653] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:18 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:19.959034 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-8e36eb40-ccf4-4c02-9cc1-5fb9a644f18b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:19.960488 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-8e36eb40-ccf4-4c02-9cc1-5fb9a644f18b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:19.968517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8e36eb40-ccf4-4c02-9cc1-5fb9a644f18b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:19.969808 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8e36eb40-ccf4-4c02-9cc1-5fb9a644f18b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:19.969808 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8e36eb40-ccf4-4c02-9cc1-5fb9a644f18b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:19.970465 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8e36eb40-ccf4-4c02-9cc1-5fb9a644f18b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:19.970962 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8e36eb40-ccf4-4c02-9cc1-5fb9a644f18b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:19.971386 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8e36eb40-ccf4-4c02-9cc1-5fb9a644f18b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:20.111023 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8e36eb40-ccf4-4c02-9cc1-5fb9a644f18b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:20.122423 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8e36eb40-ccf4-4c02-9cc1-5fb9a644f18b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:20.123992 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8e36eb40-ccf4-4c02-9cc1-5fb9a644f18b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:20.125217 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-8e36eb40-ccf4-4c02-9cc1-5fb9a644f18b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1745 microversion: 2.20 time: 0.170406 Aug 05 20:09:20.125781 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 315/654] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:19 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:20.698197 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-979579be-6e6c-4e54-b97a-a0879e7b219f req-6fed0790-2723-4e1c-b1f5-b03c2bd0cdb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98e6fc07-61b1-455d-8bf0-563c5debbebb", "name": "network-vif-plugged", "status": "completed", "tag": "e1afce7c-4bdd-432b-905f-443b0227fa80"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:20.711195 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-979579be-6e6c-4e54-b97a-a0879e7b219f req-6fed0790-2723-4e1c-b1f5-b03c2bd0cdb4 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:20.711680 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-979579be-6e6c-4e54-b97a-a0879e7b219f req-6fed0790-2723-4e1c-b1f5-b03c2bd0cdb4 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:20.712110 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-979579be-6e6c-4e54-b97a-a0879e7b219f req-6fed0790-2723-4e1c-b1f5-b03c2bd0cdb4 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:20.724908 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-979579be-6e6c-4e54-b97a-a0879e7b219f req-6fed0790-2723-4e1c-b1f5-b03c2bd0cdb4 service nova] Creating event network-vif-plugged:e1afce7c-4bdd-432b-905f-443b0227fa80 for instance 98e6fc07-61b1-455d-8bf0-563c5debbebb on hv-cinder-85221 Aug 05 20:09:20.731852 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-979579be-6e6c-4e54-b97a-a0879e7b219f req-6fed0790-2723-4e1c-b1f5-b03c2bd0cdb4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037519 Aug 05 20:09:20.733123 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 340/655] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:09:21.150699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-1a31733d-08eb-478f-91cc-5fe0a87b3bc5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:21.151341 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-1a31733d-08eb-478f-91cc-5fe0a87b3bc5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:21.158730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1a31733d-08eb-478f-91cc-5fe0a87b3bc5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:21.159247 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1a31733d-08eb-478f-91cc-5fe0a87b3bc5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:21.159692 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1a31733d-08eb-478f-91cc-5fe0a87b3bc5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:21.160390 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1a31733d-08eb-478f-91cc-5fe0a87b3bc5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:21.160880 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1a31733d-08eb-478f-91cc-5fe0a87b3bc5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:21.161330 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1a31733d-08eb-478f-91cc-5fe0a87b3bc5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:21.299355 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-1a31733d-08eb-478f-91cc-5fe0a87b3bc5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:21.308105 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-1a31733d-08eb-478f-91cc-5fe0a87b3bc5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:21.309634 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-1a31733d-08eb-478f-91cc-5fe0a87b3bc5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:21.310814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-1a31733d-08eb-478f-91cc-5fe0a87b3bc5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1745 microversion: 2.20 time: 0.164100 Aug 05 20:09:21.311589 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 316/656] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:21 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:22.336336 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a93b9f03-cadd-4dcc-98fb-8decb46f8ec6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:22.336993 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a93b9f03-cadd-4dcc-98fb-8decb46f8ec6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:22.343977 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a93b9f03-cadd-4dcc-98fb-8decb46f8ec6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:22.344466 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a93b9f03-cadd-4dcc-98fb-8decb46f8ec6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:22.344940 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a93b9f03-cadd-4dcc-98fb-8decb46f8ec6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:22.345630 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a93b9f03-cadd-4dcc-98fb-8decb46f8ec6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:22.346088 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a93b9f03-cadd-4dcc-98fb-8decb46f8ec6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:22.346543 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a93b9f03-cadd-4dcc-98fb-8decb46f8ec6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:22.485656 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a93b9f03-cadd-4dcc-98fb-8decb46f8ec6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:22.493591 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a93b9f03-cadd-4dcc-98fb-8decb46f8ec6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:22.495142 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a93b9f03-cadd-4dcc-98fb-8decb46f8ec6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:22.496362 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a93b9f03-cadd-4dcc-98fb-8decb46f8ec6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1745 microversion: 2.20 time: 0.164800 Aug 05 20:09:22.496941 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 341/657] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:22 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:23.519788 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-cd6f16e3-118f-4416-a015-351ae952ce3e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:23.520329 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-cd6f16e3-118f-4416-a015-351ae952ce3e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:23.527047 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cd6f16e3-118f-4416-a015-351ae952ce3e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:23.527524 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cd6f16e3-118f-4416-a015-351ae952ce3e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:23.527954 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cd6f16e3-118f-4416-a015-351ae952ce3e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:23.528655 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cd6f16e3-118f-4416-a015-351ae952ce3e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:23.529103 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cd6f16e3-118f-4416-a015-351ae952ce3e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:23.529521 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cd6f16e3-118f-4416-a015-351ae952ce3e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:23.666454 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-cd6f16e3-118f-4416-a015-351ae952ce3e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:23.675128 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-cd6f16e3-118f-4416-a015-351ae952ce3e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:23.676655 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-cd6f16e3-118f-4416-a015-351ae952ce3e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:23.677797 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-cd6f16e3-118f-4416-a015-351ae952ce3e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1745 microversion: 2.20 time: 0.161977 Aug 05 20:09:23.678361 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 317/658] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:23 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:24.702658 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-e3f03f28-3fa5-498b-8e6e-ce3d840de872 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:24.703791 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-e3f03f28-3fa5-498b-8e6e-ce3d840de872 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:24.713067 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e3f03f28-3fa5-498b-8e6e-ce3d840de872 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:24.714219 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e3f03f28-3fa5-498b-8e6e-ce3d840de872 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:24.714648 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e3f03f28-3fa5-498b-8e6e-ce3d840de872 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:24.715665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e3f03f28-3fa5-498b-8e6e-ce3d840de872 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:24.716314 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e3f03f28-3fa5-498b-8e6e-ce3d840de872 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:24.716788 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e3f03f28-3fa5-498b-8e6e-ce3d840de872 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:24.912846 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-e3f03f28-3fa5-498b-8e6e-ce3d840de872 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:24.924111 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-e3f03f28-3fa5-498b-8e6e-ce3d840de872 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:24.925945 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-e3f03f28-3fa5-498b-8e6e-ce3d840de872 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:24.927194 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-e3f03f28-3fa5-498b-8e6e-ce3d840de872 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1740 microversion: 2.20 time: 0.229269 Aug 05 20:09:24.927822 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 342/659] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:24 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:25.178137 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-05d7350e-8cab-4514-89ef-4aa18de932a5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0efc580c-295e-4061-aedc-195f049f7f1e"}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:25.182013 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-05d7350e-8cab-4514-89ef-4aa18de932a5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:25.189029 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-05d7350e-8cab-4514-89ef-4aa18de932a5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:25.189799 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-05d7350e-8cab-4514-89ef-4aa18de932a5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:25.190245 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-05d7350e-8cab-4514-89ef-4aa18de932a5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:25.190971 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-05d7350e-8cab-4514-89ef-4aa18de932a5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:25.191424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-05d7350e-8cab-4514-89ef-4aa18de932a5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:25.191847 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-05d7350e-8cab-4514-89ef-4aa18de932a5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:25.539401 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-05d7350e-8cab-4514-89ef-4aa18de932a5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "POST /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.507691 Aug 05 20:09:25.540415 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 318/660] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Aug 5 20:09:25 2022] POST /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1/os-volume_attachments => generated 194 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:09:25.954985 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-fe2a1bf7-fe48-49d1-bc88-889b66ed029a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:25.955602 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-fe2a1bf7-fe48-49d1-bc88-889b66ed029a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:25.969528 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fe2a1bf7-fe48-49d1-bc88-889b66ed029a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:25.970126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fe2a1bf7-fe48-49d1-bc88-889b66ed029a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:25.971486 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fe2a1bf7-fe48-49d1-bc88-889b66ed029a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:25.976136 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fe2a1bf7-fe48-49d1-bc88-889b66ed029a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:25.976699 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fe2a1bf7-fe48-49d1-bc88-889b66ed029a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:25.977318 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fe2a1bf7-fe48-49d1-bc88-889b66ed029a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:26.180263 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-fe2a1bf7-fe48-49d1-bc88-889b66ed029a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:26.191614 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-fe2a1bf7-fe48-49d1-bc88-889b66ed029a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:26.194226 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-fe2a1bf7-fe48-49d1-bc88-889b66ed029a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:26.195960 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-fe2a1bf7-fe48-49d1-bc88-889b66ed029a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1740 microversion: 2.20 time: 0.244848 Aug 05 20:09:26.197107 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 343/661] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:25 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1740 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:27.230900 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-aa8e3b77-55f4-475e-9cc8-b47ffbb5960c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:27.232595 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-aa8e3b77-55f4-475e-9cc8-b47ffbb5960c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:27.240489 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-aa8e3b77-55f4-475e-9cc8-b47ffbb5960c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:27.241373 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-aa8e3b77-55f4-475e-9cc8-b47ffbb5960c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:27.242051 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-aa8e3b77-55f4-475e-9cc8-b47ffbb5960c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:27.243035 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-aa8e3b77-55f4-475e-9cc8-b47ffbb5960c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:27.243720 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-aa8e3b77-55f4-475e-9cc8-b47ffbb5960c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:27.244380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-aa8e3b77-55f4-475e-9cc8-b47ffbb5960c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:27.402209 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-aa8e3b77-55f4-475e-9cc8-b47ffbb5960c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:27.413165 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-aa8e3b77-55f4-475e-9cc8-b47ffbb5960c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:27.415218 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-aa8e3b77-55f4-475e-9cc8-b47ffbb5960c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:27.416564 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-aa8e3b77-55f4-475e-9cc8-b47ffbb5960c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1740 microversion: 2.20 time: 0.191375 Aug 05 20:09:27.417268 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 319/662] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:27 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:28.445194 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ad9d487b-3f33-4f0f-beaa-6bd12c1c7c1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:28.446439 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-ad9d487b-3f33-4f0f-beaa-6bd12c1c7c1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:28.453321 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell0:SELECT=4 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:28.457401 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ad9d487b-3f33-4f0f-beaa-6bd12c1c7c1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:28.457990 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ad9d487b-3f33-4f0f-beaa-6bd12c1c7c1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:28.458496 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ad9d487b-3f33-4f0f-beaa-6bd12c1c7c1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:28.459483 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ad9d487b-3f33-4f0f-beaa-6bd12c1c7c1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:28.460161 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ad9d487b-3f33-4f0f-beaa-6bd12c1c7c1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:28.460817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ad9d487b-3f33-4f0f-beaa-6bd12c1c7c1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:28.489079 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:28.617839 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-ad9d487b-3f33-4f0f-beaa-6bd12c1c7c1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:28.627165 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-ad9d487b-3f33-4f0f-beaa-6bd12c1c7c1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:28.628693 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-ad9d487b-3f33-4f0f-beaa-6bd12c1c7c1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:28.629846 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-ad9d487b-3f33-4f0f-beaa-6bd12c1c7c1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1740 microversion: 2.20 time: 0.188882 Aug 05 20:09:28.630392 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 344/663] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:28 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:29.657485 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e88894f4-7cd8-427e-b4e6-d7ebd5f44ed0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:29.658013 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e88894f4-7cd8-427e-b4e6-d7ebd5f44ed0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:29.664882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e88894f4-7cd8-427e-b4e6-d7ebd5f44ed0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:29.665362 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e88894f4-7cd8-427e-b4e6-d7ebd5f44ed0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:29.665789 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e88894f4-7cd8-427e-b4e6-d7ebd5f44ed0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:29.666510 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e88894f4-7cd8-427e-b4e6-d7ebd5f44ed0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:29.667177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e88894f4-7cd8-427e-b4e6-d7ebd5f44ed0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:29.667711 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e88894f4-7cd8-427e-b4e6-d7ebd5f44ed0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:29.839957 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e88894f4-7cd8-427e-b4e6-d7ebd5f44ed0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:29.853839 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e88894f4-7cd8-427e-b4e6-d7ebd5f44ed0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:29.858695 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e88894f4-7cd8-427e-b4e6-d7ebd5f44ed0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:29.860149 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e88894f4-7cd8-427e-b4e6-d7ebd5f44ed0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1740 microversion: 2.20 time: 0.206705 Aug 05 20:09:29.873317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 320/664] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:29 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:30.884598 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-310091fa-2f80-435c-a314-a9f39e86aa51 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:30.887191 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-310091fa-2f80-435c-a314-a9f39e86aa51 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:30.894218 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-310091fa-2f80-435c-a314-a9f39e86aa51 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:30.894952 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-310091fa-2f80-435c-a314-a9f39e86aa51 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:30.895600 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-310091fa-2f80-435c-a314-a9f39e86aa51 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:30.896677 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-310091fa-2f80-435c-a314-a9f39e86aa51 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:30.897199 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-310091fa-2f80-435c-a314-a9f39e86aa51 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:30.897716 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-310091fa-2f80-435c-a314-a9f39e86aa51 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:31.086881 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-310091fa-2f80-435c-a314-a9f39e86aa51 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:31.096679 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-310091fa-2f80-435c-a314-a9f39e86aa51 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:31.098221 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-310091fa-2f80-435c-a314-a9f39e86aa51 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:31.099476 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-310091fa-2f80-435c-a314-a9f39e86aa51 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1740 microversion: 2.20 time: 0.219132 Aug 05 20:09:31.100431 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 345/665] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:30 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:09:32.125691 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9f4abd46-7324-46ab-9947-f7a46a8bcdad tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:32.126442 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-9f4abd46-7324-46ab-9947-f7a46a8bcdad tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:32.133296 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9f4abd46-7324-46ab-9947-f7a46a8bcdad tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:32.133857 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9f4abd46-7324-46ab-9947-f7a46a8bcdad tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:32.134356 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9f4abd46-7324-46ab-9947-f7a46a8bcdad tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:32.135283 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9f4abd46-7324-46ab-9947-f7a46a8bcdad tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:32.136946 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9f4abd46-7324-46ab-9947-f7a46a8bcdad tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:32.137581 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9f4abd46-7324-46ab-9947-f7a46a8bcdad tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:32.284785 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9f4abd46-7324-46ab-9947-f7a46a8bcdad tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:32.297771 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9f4abd46-7324-46ab-9947-f7a46a8bcdad tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:32.299426 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9f4abd46-7324-46ab-9947-f7a46a8bcdad tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:32.301876 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-9f4abd46-7324-46ab-9947-f7a46a8bcdad tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1740 microversion: 2.20 time: 0.180398 Aug 05 20:09:32.302555 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 321/666] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:32 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:33.329959 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-84192372-2f66-468a-bd02-9334f84283d5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:33.330662 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-84192372-2f66-468a-bd02-9334f84283d5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:33.332772 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:33.345531 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-84192372-2f66-468a-bd02-9334f84283d5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:33.346031 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-84192372-2f66-468a-bd02-9334f84283d5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:33.346472 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-84192372-2f66-468a-bd02-9334f84283d5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:33.347203 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-84192372-2f66-468a-bd02-9334f84283d5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:33.349870 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-84192372-2f66-468a-bd02-9334f84283d5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:33.350787 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-84192372-2f66-468a-bd02-9334f84283d5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:33.519856 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-84192372-2f66-468a-bd02-9334f84283d5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:33.530992 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-84192372-2f66-468a-bd02-9334f84283d5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:33.532821 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-84192372-2f66-468a-bd02-9334f84283d5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:33.533986 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-84192372-2f66-468a-bd02-9334f84283d5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1740 microversion: 2.20 time: 0.211156 Aug 05 20:09:33.534544 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 346/667] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:33 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:34.313557 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9fcf6a32-640c-4b51-8c90-de2e8152917e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:34.315908 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-9fcf6a32-640c-4b51-8c90-de2e8152917e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:34.322382 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9fcf6a32-640c-4b51-8c90-de2e8152917e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:34.323156 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9fcf6a32-640c-4b51-8c90-de2e8152917e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:34.324175 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9fcf6a32-640c-4b51-8c90-de2e8152917e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:34.325683 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9fcf6a32-640c-4b51-8c90-de2e8152917e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:34.326326 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9fcf6a32-640c-4b51-8c90-de2e8152917e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:34.326917 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9fcf6a32-640c-4b51-8c90-de2e8152917e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:34.351336 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.objects.instance [None req-9fcf6a32-640c-4b51-8c90-de2e8152917e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lazy-loading 'flavor' on Instance uuid 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 {{(pid=118191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:09:34.497497 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-9fcf6a32-640c-4b51-8c90-de2e8152917e tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "POST /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1/action" status: 200 len: 32 microversion: 2.1 time: 0.187839 Aug 05 20:09:34.498175 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 322/668] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Aug 5 20:09:34 2022] POST /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1/action => generated 32 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:09:34.507685 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a4be80bb-8863-437b-bb29-17cc3ef87f16 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:34.508288 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a4be80bb-8863-437b-bb29-17cc3ef87f16 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:34.516705 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a4be80bb-8863-437b-bb29-17cc3ef87f16 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:34.517519 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a4be80bb-8863-437b-bb29-17cc3ef87f16 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:34.517970 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a4be80bb-8863-437b-bb29-17cc3ef87f16 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:34.518902 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a4be80bb-8863-437b-bb29-17cc3ef87f16 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:34.519550 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a4be80bb-8863-437b-bb29-17cc3ef87f16 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:34.519967 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a4be80bb-8863-437b-bb29-17cc3ef87f16 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:34.559747 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-24115442-bf59-4036-8599-75afa51616ea tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:34.560765 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-24115442-bf59-4036-8599-75afa51616ea tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:34.567243 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24115442-bf59-4036-8599-75afa51616ea tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:34.567785 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24115442-bf59-4036-8599-75afa51616ea tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:34.568323 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24115442-bf59-4036-8599-75afa51616ea tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:34.569205 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24115442-bf59-4036-8599-75afa51616ea tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:34.569784 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24115442-bf59-4036-8599-75afa51616ea tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:34.570625 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24115442-bf59-4036-8599-75afa51616ea tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:34.597166 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:34.721563 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a4be80bb-8863-437b-bb29-17cc3ef87f16 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:34.733820 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a4be80bb-8863-437b-bb29-17cc3ef87f16 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.230024 Aug 05 20:09:34.740139 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 347/669] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:34 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:34.797640 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-24115442-bf59-4036-8599-75afa51616ea tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:34.807310 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-24115442-bf59-4036-8599-75afa51616ea tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:34.808855 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-24115442-bf59-4036-8599-75afa51616ea tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:34.810174 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-24115442-bf59-4036-8599-75afa51616ea tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1740 microversion: 2.20 time: 0.255299 Aug 05 20:09:34.827896 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 323/670] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:34 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1740 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:35.756823 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-25f0ea40-3d8f-4745-a853-e7dcc37c5cb2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:35.757743 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-25f0ea40-3d8f-4745-a853-e7dcc37c5cb2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:35.767032 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-25f0ea40-3d8f-4745-a853-e7dcc37c5cb2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:35.767527 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-25f0ea40-3d8f-4745-a853-e7dcc37c5cb2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:35.767964 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-25f0ea40-3d8f-4745-a853-e7dcc37c5cb2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:35.768702 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-25f0ea40-3d8f-4745-a853-e7dcc37c5cb2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:35.769213 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-25f0ea40-3d8f-4745-a853-e7dcc37c5cb2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:35.769764 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-25f0ea40-3d8f-4745-a853-e7dcc37c5cb2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:35.834200 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-19c5c900-5282-4253-a332-e41de8690211 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:35.834961 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-19c5c900-5282-4253-a332-e41de8690211 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:35.847681 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-19c5c900-5282-4253-a332-e41de8690211 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:35.848251 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-19c5c900-5282-4253-a332-e41de8690211 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:35.848615 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-19c5c900-5282-4253-a332-e41de8690211 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:35.850019 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-19c5c900-5282-4253-a332-e41de8690211 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:35.850478 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-19c5c900-5282-4253-a332-e41de8690211 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:35.850902 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-19c5c900-5282-4253-a332-e41de8690211 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:36.026402 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-25f0ea40-3d8f-4745-a853-e7dcc37c5cb2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:36.034446 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-25f0ea40-3d8f-4745-a853-e7dcc37c5cb2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.282865 Aug 05 20:09:36.035921 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 348/671] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:35 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:36.054083 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-19c5c900-5282-4253-a332-e41de8690211 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:36.063101 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-19c5c900-5282-4253-a332-e41de8690211 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:36.065111 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-19c5c900-5282-4253-a332-e41de8690211 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:36.066271 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-19c5c900-5282-4253-a332-e41de8690211 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1740 microversion: 2.20 time: 0.235997 Aug 05 20:09:36.066832 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 324/672] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:35 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:37.057906 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-49d059c3-2618-43d0-b4d2-2cb02fdc246f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:37.058621 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-49d059c3-2618-43d0-b4d2-2cb02fdc246f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:37.065390 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-49d059c3-2618-43d0-b4d2-2cb02fdc246f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:37.065876 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-49d059c3-2618-43d0-b4d2-2cb02fdc246f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:37.066308 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-49d059c3-2618-43d0-b4d2-2cb02fdc246f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:37.067001 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-49d059c3-2618-43d0-b4d2-2cb02fdc246f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:37.067448 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-49d059c3-2618-43d0-b4d2-2cb02fdc246f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:37.067867 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-49d059c3-2618-43d0-b4d2-2cb02fdc246f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:37.091120 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a77915a2-5400-40e7-b411-df72696ce476 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:37.091916 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-a77915a2-5400-40e7-b411-df72696ce476 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:37.099193 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a77915a2-5400-40e7-b411-df72696ce476 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:37.099683 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a77915a2-5400-40e7-b411-df72696ce476 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:37.100119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a77915a2-5400-40e7-b411-df72696ce476 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:37.100840 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a77915a2-5400-40e7-b411-df72696ce476 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:37.101296 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a77915a2-5400-40e7-b411-df72696ce476 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:37.105125 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a77915a2-5400-40e7-b411-df72696ce476 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:37.285226 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-49d059c3-2618-43d0-b4d2-2cb02fdc246f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:37.290721 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a77915a2-5400-40e7-b411-df72696ce476 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:37.296067 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-49d059c3-2618-43d0-b4d2-2cb02fdc246f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.242023 Aug 05 20:09:37.297058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 349/673] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:37 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:37.299895 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a77915a2-5400-40e7-b411-df72696ce476 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:37.301538 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a77915a2-5400-40e7-b411-df72696ce476 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:37.302819 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-a77915a2-5400-40e7-b411-df72696ce476 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1722 microversion: 2.20 time: 0.216800 Aug 05 20:09:37.303452 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 325/674] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:37 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:09:38.317761 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ee469e7a-6fbf-46b7-a36f-bb7372defad3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:38.318397 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-ee469e7a-6fbf-46b7-a36f-bb7372defad3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:38.325822 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ee469e7a-6fbf-46b7-a36f-bb7372defad3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:38.326312 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ee469e7a-6fbf-46b7-a36f-bb7372defad3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:38.326743 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ee469e7a-6fbf-46b7-a36f-bb7372defad3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:38.327466 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ee469e7a-6fbf-46b7-a36f-bb7372defad3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:38.327788 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-21d80989-2730-48fa-9b3a-edcaf0a9714e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:38.328208 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ee469e7a-6fbf-46b7-a36f-bb7372defad3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:38.328313 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ee469e7a-6fbf-46b7-a36f-bb7372defad3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:38.328406 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-21d80989-2730-48fa-9b3a-edcaf0a9714e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:38.335011 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-21d80989-2730-48fa-9b3a-edcaf0a9714e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:38.336044 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-21d80989-2730-48fa-9b3a-edcaf0a9714e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:38.336525 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-21d80989-2730-48fa-9b3a-edcaf0a9714e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:38.337726 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-21d80989-2730-48fa-9b3a-edcaf0a9714e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:38.338454 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-21d80989-2730-48fa-9b3a-edcaf0a9714e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:38.339176 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-21d80989-2730-48fa-9b3a-edcaf0a9714e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:38.550400 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-ee469e7a-6fbf-46b7-a36f-bb7372defad3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:38.554432 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-21d80989-2730-48fa-9b3a-edcaf0a9714e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:38.559369 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-ee469e7a-6fbf-46b7-a36f-bb7372defad3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.245389 Aug 05 20:09:38.559957 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 350/675] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:38 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:38.563647 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-21d80989-2730-48fa-9b3a-edcaf0a9714e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:38.565199 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-21d80989-2730-48fa-9b3a-edcaf0a9714e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:38.566354 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-21d80989-2730-48fa-9b3a-edcaf0a9714e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1722 microversion: 2.20 time: 0.242453 Aug 05 20:09:38.566906 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 326/676] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:38 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:39.580615 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-60926f92-4d82-44aa-b87c-252750cb3d8b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:39.581657 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-60926f92-4d82-44aa-b87c-252750cb3d8b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:39.588599 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-60926f92-4d82-44aa-b87c-252750cb3d8b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:39.589089 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-60926f92-4d82-44aa-b87c-252750cb3d8b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:39.589522 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-60926f92-4d82-44aa-b87c-252750cb3d8b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:39.590215 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-60926f92-4d82-44aa-b87c-252750cb3d8b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:39.590668 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-60926f92-4d82-44aa-b87c-252750cb3d8b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:39.590856 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f46bbd2f-f9ea-4587-88cc-a98530b82d9a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:39.591290 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-60926f92-4d82-44aa-b87c-252750cb3d8b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:39.591474 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f46bbd2f-f9ea-4587-88cc-a98530b82d9a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:39.594502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=34 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:39.600042 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f46bbd2f-f9ea-4587-88cc-a98530b82d9a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:39.600528 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f46bbd2f-f9ea-4587-88cc-a98530b82d9a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:39.601123 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f46bbd2f-f9ea-4587-88cc-a98530b82d9a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:39.601829 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f46bbd2f-f9ea-4587-88cc-a98530b82d9a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:39.602337 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f46bbd2f-f9ea-4587-88cc-a98530b82d9a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:39.602983 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f46bbd2f-f9ea-4587-88cc-a98530b82d9a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:39.825097 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-60926f92-4d82-44aa-b87c-252750cb3d8b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:39.829730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f46bbd2f-f9ea-4587-88cc-a98530b82d9a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:39.837235 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-60926f92-4d82-44aa-b87c-252750cb3d8b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.260179 Aug 05 20:09:39.837551 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f46bbd2f-f9ea-4587-88cc-a98530b82d9a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:39.840772 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 351/677] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:39 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:39.840946 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f46bbd2f-f9ea-4587-88cc-a98530b82d9a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:39.841367 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f46bbd2f-f9ea-4587-88cc-a98530b82d9a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1722 microversion: 2.20 time: 0.256158 Aug 05 20:09:39.842101 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 327/678] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:39 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:40.840763 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-dcba6c96-b102-4c80-ab2a-4458f2acbe27 req-02aa0167-d5dd-4d2f-b204-82f250cb302e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98e6fc07-61b1-455d-8bf0-563c5debbebb", "name": "network-vif-unplugged", "status": "completed", "tag": "e1afce7c-4bdd-432b-905f-443b0227fa80"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:40.857486 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-dcba6c96-b102-4c80-ab2a-4458f2acbe27 req-02aa0167-d5dd-4d2f-b204-82f250cb302e service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:40.858121 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-dcba6c96-b102-4c80-ab2a-4458f2acbe27 req-02aa0167-d5dd-4d2f-b204-82f250cb302e service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:40.858550 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-dcba6c96-b102-4c80-ab2a-4458f2acbe27 req-02aa0167-d5dd-4d2f-b204-82f250cb302e service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:40.863239 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-238bb75e-8ae3-4a52-993d-f09ef88451d4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:40.863869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-238bb75e-8ae3-4a52-993d-f09ef88451d4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:40.871310 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.compute.server_external_events [req-dcba6c96-b102-4c80-ab2a-4458f2acbe27 req-02aa0167-d5dd-4d2f-b204-82f250cb302e service nova] Unable to find a host for instance 98e6fc07-61b1-455d-8bf0-563c5debbebb. Dropping event network-vif-unplugged {{(pid=118192) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 05 20:09:40.871474 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-238bb75e-8ae3-4a52-993d-f09ef88451d4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:40.871813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-238bb75e-8ae3-4a52-993d-f09ef88451d4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:40.872196 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-dcba6c96-b102-4c80-ab2a-4458f2acbe27 req-02aa0167-d5dd-4d2f-b204-82f250cb302e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035713 Aug 05 20:09:40.872312 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-238bb75e-8ae3-4a52-993d-f09ef88451d4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:40.872818 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 352/679] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 05 20:09:40.872977 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-238bb75e-8ae3-4a52-993d-f09ef88451d4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:40.873402 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-238bb75e-8ae3-4a52-993d-f09ef88451d4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:40.873884 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-238bb75e-8ae3-4a52-993d-f09ef88451d4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:40.877766 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-9087d204-0b1a-4fe0-ac5e-ccddc43d22cd tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:40.878338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-9087d204-0b1a-4fe0-ac5e-ccddc43d22cd tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:40.884242 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9087d204-0b1a-4fe0-ac5e-ccddc43d22cd tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:40.884788 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9087d204-0b1a-4fe0-ac5e-ccddc43d22cd tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:40.885531 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9087d204-0b1a-4fe0-ac5e-ccddc43d22cd tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:40.886628 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9087d204-0b1a-4fe0-ac5e-ccddc43d22cd tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:40.887085 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9087d204-0b1a-4fe0-ac5e-ccddc43d22cd tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:40.887514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9087d204-0b1a-4fe0-ac5e-ccddc43d22cd tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:41.077176 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-238bb75e-8ae3-4a52-993d-f09ef88451d4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:41.080367 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-9087d204-0b1a-4fe0-ac5e-ccddc43d22cd tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:41.085361 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-238bb75e-8ae3-4a52-993d-f09ef88451d4 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.228913 Aug 05 20:09:41.086156 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 328/680] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:40 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:09:41.089349 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-9087d204-0b1a-4fe0-ac5e-ccddc43d22cd tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:41.090871 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-9087d204-0b1a-4fe0-ac5e-ccddc43d22cd tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:41.092019 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-9087d204-0b1a-4fe0-ac5e-ccddc43d22cd tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1665 microversion: 2.20 time: 0.217896 Aug 05 20:09:41.092561 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 353/681] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:40 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1665 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:41.115180 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-587ebdd8-5911-469e-8b3d-6f547ec439f9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0a2e094-8931-4e8a-b410-c64f2e9ce6e8"}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:41.117607 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-587ebdd8-5911-469e-8b3d-6f547ec439f9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:41.123985 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-587ebdd8-5911-469e-8b3d-6f547ec439f9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:41.124474 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-587ebdd8-5911-469e-8b3d-6f547ec439f9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:41.124945 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-587ebdd8-5911-469e-8b3d-6f547ec439f9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:41.125641 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-587ebdd8-5911-469e-8b3d-6f547ec439f9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:41.126100 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-587ebdd8-5911-469e-8b3d-6f547ec439f9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:41.126527 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-587ebdd8-5911-469e-8b3d-6f547ec439f9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:41.411396 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-587ebdd8-5911-469e-8b3d-6f547ec439f9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "POST /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.300158 Aug 05 20:09:41.411990 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 329/682] 10.222.0.39 () {62 vars in 1364 bytes} [Fri Aug 5 20:09:41 2022] POST /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb/os-volume_attachments => generated 188 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:09:41.535957 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-e89f3223-0886-46cc-926a-9dd7e4afb5a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:41.536546 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-e89f3223-0886-46cc-926a-9dd7e4afb5a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:41.542663 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e89f3223-0886-46cc-926a-9dd7e4afb5a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:41.543151 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e89f3223-0886-46cc-926a-9dd7e4afb5a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:41.543624 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e89f3223-0886-46cc-926a-9dd7e4afb5a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:41.544332 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e89f3223-0886-46cc-926a-9dd7e4afb5a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:41.544830 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e89f3223-0886-46cc-926a-9dd7e4afb5a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:41.545249 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e89f3223-0886-46cc-926a-9dd7e4afb5a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:41.674812 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-e89f3223-0886-46cc-926a-9dd7e4afb5a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118192) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 20:09:41.741909 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-e89f3223-0886-46cc-926a-9dd7e4afb5a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "POST /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb/action" status: 202 len: 0 microversion: 2.20 time: 0.209726 Aug 05 20:09:41.742517 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 354/683] 10.222.0.39 () {62 vars in 1319 bytes} [Fri Aug 5 20:09:41 2022] POST /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:09:41.751038 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-cdb53af7-dfe2-47dc-ba0d-482a0e42a7f3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:41.751560 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-cdb53af7-dfe2-47dc-ba0d-482a0e42a7f3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:41.758202 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cdb53af7-dfe2-47dc-ba0d-482a0e42a7f3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:41.758682 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cdb53af7-dfe2-47dc-ba0d-482a0e42a7f3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:41.759113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cdb53af7-dfe2-47dc-ba0d-482a0e42a7f3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:41.760513 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cdb53af7-dfe2-47dc-ba0d-482a0e42a7f3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:41.761246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cdb53af7-dfe2-47dc-ba0d-482a0e42a7f3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:41.761666 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cdb53af7-dfe2-47dc-ba0d-482a0e42a7f3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:41.897664 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-cdb53af7-dfe2-47dc-ba0d-482a0e42a7f3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:41.906307 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-cdb53af7-dfe2-47dc-ba0d-482a0e42a7f3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:41.907814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-cdb53af7-dfe2-47dc-ba0d-482a0e42a7f3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:41.909024 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-cdb53af7-dfe2-47dc-ba0d-482a0e42a7f3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1751 microversion: 2.20 time: 0.161855 Aug 05 20:09:41.909573 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 330/684] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:41 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:09:42.108275 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-9317c4ab-3af2-414f-a6ea-3f6c182fa0ce tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:42.109083 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-9317c4ab-3af2-414f-a6ea-3f6c182fa0ce tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:42.115507 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9317c4ab-3af2-414f-a6ea-3f6c182fa0ce tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:42.116008 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9317c4ab-3af2-414f-a6ea-3f6c182fa0ce tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:42.116445 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9317c4ab-3af2-414f-a6ea-3f6c182fa0ce tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:42.117176 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9317c4ab-3af2-414f-a6ea-3f6c182fa0ce tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:42.117629 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9317c4ab-3af2-414f-a6ea-3f6c182fa0ce tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:42.118050 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9317c4ab-3af2-414f-a6ea-3f6c182fa0ce tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:42.268705 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-9317c4ab-3af2-414f-a6ea-3f6c182fa0ce tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:42.277636 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-9317c4ab-3af2-414f-a6ea-3f6c182fa0ce tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.174191 Aug 05 20:09:42.278240 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 355/685] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:42 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:42.932831 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-13a547f5-22d6-45c0-a7e9-95942b2435b4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:42.933485 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-13a547f5-22d6-45c0-a7e9-95942b2435b4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:42.939819 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-13a547f5-22d6-45c0-a7e9-95942b2435b4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:42.940309 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-13a547f5-22d6-45c0-a7e9-95942b2435b4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:42.940792 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-13a547f5-22d6-45c0-a7e9-95942b2435b4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:42.941486 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-13a547f5-22d6-45c0-a7e9-95942b2435b4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:42.941940 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-13a547f5-22d6-45c0-a7e9-95942b2435b4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:42.942365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-13a547f5-22d6-45c0-a7e9-95942b2435b4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:43.072733 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-13a547f5-22d6-45c0-a7e9-95942b2435b4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:43.081420 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-13a547f5-22d6-45c0-a7e9-95942b2435b4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:43.082921 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-13a547f5-22d6-45c0-a7e9-95942b2435b4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:43.084082 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-13a547f5-22d6-45c0-a7e9-95942b2435b4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1753 microversion: 2.20 time: 0.155195 Aug 05 20:09:43.084660 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 331/686] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:42 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:43.298760 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-316377c1-2cb4-4a2a-bd79-ded447265167 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:43.299374 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-316377c1-2cb4-4a2a-bd79-ded447265167 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:43.305735 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-316377c1-2cb4-4a2a-bd79-ded447265167 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:43.306257 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-316377c1-2cb4-4a2a-bd79-ded447265167 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:43.306700 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-316377c1-2cb4-4a2a-bd79-ded447265167 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:43.307388 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-316377c1-2cb4-4a2a-bd79-ded447265167 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:43.307839 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-316377c1-2cb4-4a2a-bd79-ded447265167 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:43.308267 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-316377c1-2cb4-4a2a-bd79-ded447265167 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:43.437179 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-316377c1-2cb4-4a2a-bd79-ded447265167 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:43.446106 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-316377c1-2cb4-4a2a-bd79-ded447265167 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.151214 Aug 05 20:09:43.446669 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 356/687] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:43 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:44.108187 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e759003b-da82-4352-b45e-5eeea820e801 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:44.108831 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e759003b-da82-4352-b45e-5eeea820e801 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:44.115496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e759003b-da82-4352-b45e-5eeea820e801 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:44.115980 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e759003b-da82-4352-b45e-5eeea820e801 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:44.116405 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e759003b-da82-4352-b45e-5eeea820e801 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:44.117119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e759003b-da82-4352-b45e-5eeea820e801 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:44.117565 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e759003b-da82-4352-b45e-5eeea820e801 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:44.117986 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e759003b-da82-4352-b45e-5eeea820e801 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:44.254352 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e759003b-da82-4352-b45e-5eeea820e801 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:44.263640 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e759003b-da82-4352-b45e-5eeea820e801 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:44.265482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e759003b-da82-4352-b45e-5eeea820e801 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:44.266650 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e759003b-da82-4352-b45e-5eeea820e801 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1809 microversion: 2.20 time: 0.162467 Aug 05 20:09:44.267205 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 332/688] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:44 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:09:44.467337 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-fa8abdf9-f257-41b0-b71d-46206c8d4e43 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:44.467987 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-fa8abdf9-f257-41b0-b71d-46206c8d4e43 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:44.474434 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fa8abdf9-f257-41b0-b71d-46206c8d4e43 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:44.474919 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fa8abdf9-f257-41b0-b71d-46206c8d4e43 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:44.475357 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fa8abdf9-f257-41b0-b71d-46206c8d4e43 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:44.476047 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fa8abdf9-f257-41b0-b71d-46206c8d4e43 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:44.476518 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fa8abdf9-f257-41b0-b71d-46206c8d4e43 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:44.476969 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fa8abdf9-f257-41b0-b71d-46206c8d4e43 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:44.608152 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-fa8abdf9-f257-41b0-b71d-46206c8d4e43 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:44.616173 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-fa8abdf9-f257-41b0-b71d-46206c8d4e43 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.152680 Aug 05 20:09:44.616763 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 357/689] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:44 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:45.290613 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-dc005f31-a21f-4a1c-adcf-12321e67cd9e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:45.291245 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-dc005f31-a21f-4a1c-adcf-12321e67cd9e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:45.300039 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dc005f31-a21f-4a1c-adcf-12321e67cd9e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:45.300534 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dc005f31-a21f-4a1c-adcf-12321e67cd9e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:45.301005 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dc005f31-a21f-4a1c-adcf-12321e67cd9e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:45.301719 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dc005f31-a21f-4a1c-adcf-12321e67cd9e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:45.302173 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dc005f31-a21f-4a1c-adcf-12321e67cd9e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:45.302605 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dc005f31-a21f-4a1c-adcf-12321e67cd9e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:45.503765 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-f5d2885a-6d91-4027-8df7-67e0487bc8a0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-326879372", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1158990661", "security_groups": [{"name": "tempest-secgroup-smoke-1565201125"}], "block_device_mapping_v2": [{"uuid": "6945fbb8-bc0b-422f-950b-a0d06025315b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9c8ea1a5-5b07-4174-af4e-dcae22583662"}]}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:09:45.513117 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-dc005f31-a21f-4a1c-adcf-12321e67cd9e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:45.522135 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-dc005f31-a21f-4a1c-adcf-12321e67cd9e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:45.523759 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-dc005f31-a21f-4a1c-adcf-12321e67cd9e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:45.525917 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-dc005f31-a21f-4a1c-adcf-12321e67cd9e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1809 microversion: 2.20 time: 0.238837 Aug 05 20:09:45.527568 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 333/690] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:45 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1809 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:45.630627 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.network.neutron [None req-f5d2885a-6d91-4027-8df7-67e0487bc8a0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] validate_networks() for [('9c8ea1a5-5b07-4174-af4e-dcae22583662', None, None, None, None, None)] {{(pid=118192) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:09:45.639670 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-c51b5d54-eaf7-4bb2-aa97-9a0c6f34743a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:45.640421 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-c51b5d54-eaf7-4bb2-aa97-9a0c6f34743a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:45.647262 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c51b5d54-eaf7-4bb2-aa97-9a0c6f34743a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:45.648950 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c51b5d54-eaf7-4bb2-aa97-9a0c6f34743a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:45.649643 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c51b5d54-eaf7-4bb2-aa97-9a0c6f34743a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:45.650939 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c51b5d54-eaf7-4bb2-aa97-9a0c6f34743a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:45.651581 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c51b5d54-eaf7-4bb2-aa97-9a0c6f34743a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:45.652199 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c51b5d54-eaf7-4bb2-aa97-9a0c6f34743a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:45.852292 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-c51b5d54-eaf7-4bb2-aa97-9a0c6f34743a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:45.861918 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-c51b5d54-eaf7-4bb2-aa97-9a0c6f34743a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.226407 Aug 05 20:09:45.864678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 334/691] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:45 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:09:46.107516 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-f5d2885a-6d91-4027-8df7-67e0487bc8a0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Flavor limits 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:09:46.107945 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-f5d2885a-6d91-4027-8df7-67e0487bc8a0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Image limits 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:09:46.108428 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-f5d2885a-6d91-4027-8df7-67e0487bc8a0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Flavor pref 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:09:46.108891 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-f5d2885a-6d91-4027-8df7-67e0487bc8a0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Image pref 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:09:46.109311 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-f5d2885a-6d91-4027-8df7-67e0487bc8a0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:09:46.118173 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f5d2885a-6d91-4027-8df7-67e0487bc8a0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:46.118724 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f5d2885a-6d91-4027-8df7-67e0487bc8a0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:46.119171 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f5d2885a-6d91-4027-8df7-67e0487bc8a0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:46.119992 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f5d2885a-6d91-4027-8df7-67e0487bc8a0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:46.120456 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f5d2885a-6d91-4027-8df7-67e0487bc8a0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:46.120911 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f5d2885a-6d91-4027-8df7-67e0487bc8a0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:46.138330 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-f5d2885a-6d91-4027-8df7-67e0487bc8a0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Getting quotas for project cd1707d3a6c640b78baeb522cfb7ecdb. Resources: {'cores', 'ram', 'instances'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:09:46.143063 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-f5d2885a-6d91-4027-8df7-67e0487bc8a0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Getting quotas for user b5d959f3af3745ed8e0bc4a67faf34f1 and project cd1707d3a6c640b78baeb522cfb7ecdb. Resources: {'cores', 'ram', 'instances'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:09:46.218497 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-f5d2885a-6d91-4027-8df7-67e0487bc8a0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Going to run 1 instances... {{(pid=118192) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:09:46.220570 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-f5d2885a-6d91-4027-8df7-67e0487bc8a0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6945fbb8-bc0b-422f-950b-a0d06025315b',volume_size=None,volume_type=None)] {{(pid=118192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:09:46.362844 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-f5d2885a-6d91-4027-8df7-67e0487bc8a0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.862651 Aug 05 20:09:46.363391 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 358/692] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Aug 5 20:09:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 20:09:46.381490 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e6bc2d11-de83-4d04-8f36-eb76419fc5fa tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:46.382099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e6bc2d11-de83-4d04-8f36-eb76419fc5fa tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:46.456662 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e6bc2d11-de83-4d04-8f36-eb76419fc5fa tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:46.465099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e6bc2d11-de83-4d04-8f36-eb76419fc5fa tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1094 microversion: 2.1 time: 0.093678 Aug 05 20:09:46.465671 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 335/693] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:46 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1094 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:46.551528 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-7e43d565-451d-4a22-9637-24b67dd8b382 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:46.552162 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-7e43d565-451d-4a22-9637-24b67dd8b382 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:46.558872 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7e43d565-451d-4a22-9637-24b67dd8b382 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:46.559361 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7e43d565-451d-4a22-9637-24b67dd8b382 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:46.559818 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7e43d565-451d-4a22-9637-24b67dd8b382 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:46.560487 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7e43d565-451d-4a22-9637-24b67dd8b382 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:46.560970 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7e43d565-451d-4a22-9637-24b67dd8b382 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:46.561404 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7e43d565-451d-4a22-9637-24b67dd8b382 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:46.731166 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-7e43d565-451d-4a22-9637-24b67dd8b382 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:46.742230 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-7e43d565-451d-4a22-9637-24b67dd8b382 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:46.745513 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-7e43d565-451d-4a22-9637-24b67dd8b382 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:46.746914 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-7e43d565-451d-4a22-9637-24b67dd8b382 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1809 microversion: 2.20 time: 0.199901 Aug 05 20:09:46.747775 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 359/694] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:46 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:46.883201 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-5901b0f2-dbac-4936-b3dc-8d5767ec9644 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:46.883815 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-5901b0f2-dbac-4936-b3dc-8d5767ec9644 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:46.891446 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5901b0f2-dbac-4936-b3dc-8d5767ec9644 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:46.891938 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5901b0f2-dbac-4936-b3dc-8d5767ec9644 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:46.892379 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5901b0f2-dbac-4936-b3dc-8d5767ec9644 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:46.893097 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5901b0f2-dbac-4936-b3dc-8d5767ec9644 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:46.893559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5901b0f2-dbac-4936-b3dc-8d5767ec9644 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:46.893984 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5901b0f2-dbac-4936-b3dc-8d5767ec9644 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:47.032205 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-5901b0f2-dbac-4936-b3dc-8d5767ec9644 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:47.042372 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-5901b0f2-dbac-4936-b3dc-8d5767ec9644 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.161599 Aug 05 20:09:47.042967 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 336/695] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:46 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:47.485600 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b5c3bbc0-74fc-498d-8671-e72ad26693b5 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:47.486469 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-b5c3bbc0-74fc-498d-8671-e72ad26693b5 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:47.492791 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5c3bbc0-74fc-498d-8671-e72ad26693b5 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:47.493499 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5c3bbc0-74fc-498d-8671-e72ad26693b5 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:47.494110 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5c3bbc0-74fc-498d-8671-e72ad26693b5 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:47.494973 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5c3bbc0-74fc-498d-8671-e72ad26693b5 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:47.495598 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5c3bbc0-74fc-498d-8671-e72ad26693b5 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:47.496175 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5c3bbc0-74fc-498d-8671-e72ad26693b5 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:47.560719 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-b5c3bbc0-74fc-498d-8671-e72ad26693b5 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:47.567920 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b5c3bbc0-74fc-498d-8671-e72ad26693b5 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1144 microversion: 2.1 time: 0.086340 Aug 05 20:09:47.568485 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 360/696] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:47 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:47.771535 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9ab9454d-d650-4100-a761-83a6070acd4c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:47.772060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-9ab9454d-d650-4100-a761-83a6070acd4c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:47.779952 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9ab9454d-d650-4100-a761-83a6070acd4c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:47.780442 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9ab9454d-d650-4100-a761-83a6070acd4c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:47.780919 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9ab9454d-d650-4100-a761-83a6070acd4c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:47.781733 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9ab9454d-d650-4100-a761-83a6070acd4c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:47.782188 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9ab9454d-d650-4100-a761-83a6070acd4c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:47.782639 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9ab9454d-d650-4100-a761-83a6070acd4c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:47.920294 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9ab9454d-d650-4100-a761-83a6070acd4c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:47.932236 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9ab9454d-d650-4100-a761-83a6070acd4c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:47.933889 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9ab9454d-d650-4100-a761-83a6070acd4c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:47.935097 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-9ab9454d-d650-4100-a761-83a6070acd4c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1809 microversion: 2.20 time: 0.167618 Aug 05 20:09:47.936007 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 337/697] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:47 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:48.063451 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-d4eccafb-2ffc-46e1-a4bc-94dbc31c8ab9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:48.063989 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-d4eccafb-2ffc-46e1-a4bc-94dbc31c8ab9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:48.069929 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d4eccafb-2ffc-46e1-a4bc-94dbc31c8ab9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:48.070418 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d4eccafb-2ffc-46e1-a4bc-94dbc31c8ab9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:48.070859 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d4eccafb-2ffc-46e1-a4bc-94dbc31c8ab9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:48.071560 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d4eccafb-2ffc-46e1-a4bc-94dbc31c8ab9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:48.072010 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d4eccafb-2ffc-46e1-a4bc-94dbc31c8ab9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:48.072442 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d4eccafb-2ffc-46e1-a4bc-94dbc31c8ab9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:48.076280 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:48.221887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-d4eccafb-2ffc-46e1-a4bc-94dbc31c8ab9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:48.230239 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-d4eccafb-2ffc-46e1-a4bc-94dbc31c8ab9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.170739 Aug 05 20:09:48.230814 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 361/698] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:48 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:09:48.593037 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a412cffe-cc01-4a64-9b75-1c47d35e7366 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:48.593928 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-a412cffe-cc01-4a64-9b75-1c47d35e7366 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:48.600605 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a412cffe-cc01-4a64-9b75-1c47d35e7366 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:48.601111 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a412cffe-cc01-4a64-9b75-1c47d35e7366 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:48.601539 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a412cffe-cc01-4a64-9b75-1c47d35e7366 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:48.602231 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a412cffe-cc01-4a64-9b75-1c47d35e7366 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:48.602677 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a412cffe-cc01-4a64-9b75-1c47d35e7366 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:48.603147 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a412cffe-cc01-4a64-9b75-1c47d35e7366 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:48.619117 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:48.671894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a412cffe-cc01-4a64-9b75-1c47d35e7366 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:48.679390 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-a412cffe-cc01-4a64-9b75-1c47d35e7366 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1144 microversion: 2.1 time: 0.091565 Aug 05 20:09:48.679961 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 338/699] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:48 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:48.959254 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-d8ab9301-0e0e-4d81-b2bf-19eb9b83a4ac tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:48.959865 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-d8ab9301-0e0e-4d81-b2bf-19eb9b83a4ac tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:48.966274 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d8ab9301-0e0e-4d81-b2bf-19eb9b83a4ac tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:48.966764 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d8ab9301-0e0e-4d81-b2bf-19eb9b83a4ac tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:48.967201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d8ab9301-0e0e-4d81-b2bf-19eb9b83a4ac tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:48.967898 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d8ab9301-0e0e-4d81-b2bf-19eb9b83a4ac tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:48.968360 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d8ab9301-0e0e-4d81-b2bf-19eb9b83a4ac tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:48.968828 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d8ab9301-0e0e-4d81-b2bf-19eb9b83a4ac tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:49.120020 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-d8ab9301-0e0e-4d81-b2bf-19eb9b83a4ac tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:49.128764 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-d8ab9301-0e0e-4d81-b2bf-19eb9b83a4ac tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:49.130265 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-d8ab9301-0e0e-4d81-b2bf-19eb9b83a4ac tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:49.131421 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-d8ab9301-0e0e-4d81-b2bf-19eb9b83a4ac tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1809 microversion: 2.20 time: 0.176085 Aug 05 20:09:49.131966 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 362/700] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:48 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:49.251806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a0f68617-ef73-4607-bf71-7379b210d36b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:49.252377 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-a0f68617-ef73-4607-bf71-7379b210d36b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:49.258714 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a0f68617-ef73-4607-bf71-7379b210d36b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:49.259491 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a0f68617-ef73-4607-bf71-7379b210d36b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:49.259983 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a0f68617-ef73-4607-bf71-7379b210d36b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:49.260704 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a0f68617-ef73-4607-bf71-7379b210d36b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:49.261449 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a0f68617-ef73-4607-bf71-7379b210d36b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:49.261878 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a0f68617-ef73-4607-bf71-7379b210d36b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:49.398537 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a0f68617-ef73-4607-bf71-7379b210d36b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:49.407150 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-a0f68617-ef73-4607-bf71-7379b210d36b tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.159383 Aug 05 20:09:49.407712 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 339/701] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:49 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:49.700625 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-70e04572-57f9-4802-886e-a4010255dae1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:49.701244 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-70e04572-57f9-4802-886e-a4010255dae1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:49.707205 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-70e04572-57f9-4802-886e-a4010255dae1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:49.707683 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-70e04572-57f9-4802-886e-a4010255dae1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:49.708125 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-70e04572-57f9-4802-886e-a4010255dae1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:49.708928 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-70e04572-57f9-4802-886e-a4010255dae1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:49.709389 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-70e04572-57f9-4802-886e-a4010255dae1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:49.709821 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-70e04572-57f9-4802-886e-a4010255dae1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:49.778536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-70e04572-57f9-4802-886e-a4010255dae1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:49.786864 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-70e04572-57f9-4802-886e-a4010255dae1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1144 microversion: 2.1 time: 0.090410 Aug 05 20:09:49.797847 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 363/702] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:49 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1144 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:50.155493 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-5d0cbdce-b001-4fd9-a60b-706321bce56d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:50.156105 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-5d0cbdce-b001-4fd9-a60b-706321bce56d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:50.162197 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5d0cbdce-b001-4fd9-a60b-706321bce56d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:50.162685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5d0cbdce-b001-4fd9-a60b-706321bce56d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:50.163118 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5d0cbdce-b001-4fd9-a60b-706321bce56d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:50.163800 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5d0cbdce-b001-4fd9-a60b-706321bce56d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:50.164252 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5d0cbdce-b001-4fd9-a60b-706321bce56d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:50.164707 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5d0cbdce-b001-4fd9-a60b-706321bce56d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:50.303736 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-5d0cbdce-b001-4fd9-a60b-706321bce56d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:50.313150 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-5d0cbdce-b001-4fd9-a60b-706321bce56d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:50.314652 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-5d0cbdce-b001-4fd9-a60b-706321bce56d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:50.315833 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-5d0cbdce-b001-4fd9-a60b-706321bce56d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1809 microversion: 2.20 time: 0.164232 Aug 05 20:09:50.316606 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 340/703] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:50 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:50.429462 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-292528af-455c-44a4-9d4c-b2d04405aaca tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:50.432698 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-292528af-455c-44a4-9d4c-b2d04405aaca tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:50.442757 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-292528af-455c-44a4-9d4c-b2d04405aaca tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:50.443640 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-292528af-455c-44a4-9d4c-b2d04405aaca tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:50.444365 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-292528af-455c-44a4-9d4c-b2d04405aaca tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:50.445377 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-292528af-455c-44a4-9d4c-b2d04405aaca tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:50.446160 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-292528af-455c-44a4-9d4c-b2d04405aaca tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:50.446999 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-292528af-455c-44a4-9d4c-b2d04405aaca tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:50.589267 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-292528af-455c-44a4-9d4c-b2d04405aaca tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:50.598874 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-292528af-455c-44a4-9d4c-b2d04405aaca tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.173283 Aug 05 20:09:50.600192 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 364/704] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:50 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:50.809713 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-319998cb-9b54-4ac0-8eea-c9810d96a9d3 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:50.810239 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-319998cb-9b54-4ac0-8eea-c9810d96a9d3 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:50.816391 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-319998cb-9b54-4ac0-8eea-c9810d96a9d3 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:50.816992 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-319998cb-9b54-4ac0-8eea-c9810d96a9d3 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:50.817429 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-319998cb-9b54-4ac0-8eea-c9810d96a9d3 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:50.818114 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-319998cb-9b54-4ac0-8eea-c9810d96a9d3 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:50.818570 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-319998cb-9b54-4ac0-8eea-c9810d96a9d3 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:50.818993 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-319998cb-9b54-4ac0-8eea-c9810d96a9d3 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:50.886577 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-319998cb-9b54-4ac0-8eea-c9810d96a9d3 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:50.894312 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-319998cb-9b54-4ac0-8eea-c9810d96a9d3 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1144 microversion: 2.1 time: 0.089116 Aug 05 20:09:50.894990 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 341/705] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:50 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:51.340505 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-2bbe8cef-2d64-4425-9f0d-b7005cfe3808 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:51.341148 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-2bbe8cef-2d64-4425-9f0d-b7005cfe3808 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:51.347194 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2bbe8cef-2d64-4425-9f0d-b7005cfe3808 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:51.347688 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2bbe8cef-2d64-4425-9f0d-b7005cfe3808 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:51.348126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2bbe8cef-2d64-4425-9f0d-b7005cfe3808 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:51.348854 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2bbe8cef-2d64-4425-9f0d-b7005cfe3808 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:51.349314 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2bbe8cef-2d64-4425-9f0d-b7005cfe3808 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:51.349742 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2bbe8cef-2d64-4425-9f0d-b7005cfe3808 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:51.493143 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-2bbe8cef-2d64-4425-9f0d-b7005cfe3808 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:51.502156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-2bbe8cef-2d64-4425-9f0d-b7005cfe3808 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:51.503664 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-2bbe8cef-2d64-4425-9f0d-b7005cfe3808 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:51.504885 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-2bbe8cef-2d64-4425-9f0d-b7005cfe3808 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1809 microversion: 2.20 time: 0.169303 Aug 05 20:09:51.505982 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 365/706] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:51 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:51.620872 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-5a9a7198-aac4-4dd4-a9e3-f11d2ecd84ff tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:51.621553 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-5a9a7198-aac4-4dd4-a9e3-f11d2ecd84ff tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:51.628589 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5a9a7198-aac4-4dd4-a9e3-f11d2ecd84ff tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:51.629328 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5a9a7198-aac4-4dd4-a9e3-f11d2ecd84ff tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:51.629973 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5a9a7198-aac4-4dd4-a9e3-f11d2ecd84ff tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:51.630862 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5a9a7198-aac4-4dd4-a9e3-f11d2ecd84ff tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:51.631480 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5a9a7198-aac4-4dd4-a9e3-f11d2ecd84ff tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:51.632074 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5a9a7198-aac4-4dd4-a9e3-f11d2ecd84ff tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:51.768936 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-5a9a7198-aac4-4dd4-a9e3-f11d2ecd84ff tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:51.778111 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-5a9a7198-aac4-4dd4-a9e3-f11d2ecd84ff tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.161112 Aug 05 20:09:51.779032 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 342/707] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:51 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:51.915917 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-0b2e2414-2945-4b25-a23c-a63cf4a180d1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:51.916857 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-0b2e2414-2945-4b25-a23c-a63cf4a180d1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:51.922836 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0b2e2414-2945-4b25-a23c-a63cf4a180d1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:51.923324 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0b2e2414-2945-4b25-a23c-a63cf4a180d1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:51.923762 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0b2e2414-2945-4b25-a23c-a63cf4a180d1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:51.924463 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0b2e2414-2945-4b25-a23c-a63cf4a180d1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:51.924950 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0b2e2414-2945-4b25-a23c-a63cf4a180d1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:51.925381 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0b2e2414-2945-4b25-a23c-a63cf4a180d1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:51.992142 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-0b2e2414-2945-4b25-a23c-a63cf4a180d1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:52.000971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-0b2e2414-2945-4b25-a23c-a63cf4a180d1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1144 microversion: 2.1 time: 0.089773 Aug 05 20:09:52.001545 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 366/708] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:51 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1144 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:52.529444 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-0413140e-2f05-4bfc-81f1-ce3b2820d578 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:52.530109 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-0413140e-2f05-4bfc-81f1-ce3b2820d578 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:52.537104 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0413140e-2f05-4bfc-81f1-ce3b2820d578 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:52.537656 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0413140e-2f05-4bfc-81f1-ce3b2820d578 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:52.538091 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0413140e-2f05-4bfc-81f1-ce3b2820d578 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:52.538792 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0413140e-2f05-4bfc-81f1-ce3b2820d578 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:52.539242 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0413140e-2f05-4bfc-81f1-ce3b2820d578 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:52.539665 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0413140e-2f05-4bfc-81f1-ce3b2820d578 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:52.685724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-0413140e-2f05-4bfc-81f1-ce3b2820d578 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:52.701767 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-0413140e-2f05-4bfc-81f1-ce3b2820d578 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:52.703492 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-0413140e-2f05-4bfc-81f1-ce3b2820d578 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:52.704689 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-0413140e-2f05-4bfc-81f1-ce3b2820d578 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1809 microversion: 2.20 time: 0.179227 Aug 05 20:09:52.705255 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 343/709] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:52 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:52.799231 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-c454f705-58f3-41b5-a30a-f01b561d7f95 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:52.799841 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-c454f705-58f3-41b5-a30a-f01b561d7f95 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:52.806585 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c454f705-58f3-41b5-a30a-f01b561d7f95 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:52.807117 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c454f705-58f3-41b5-a30a-f01b561d7f95 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:52.807556 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c454f705-58f3-41b5-a30a-f01b561d7f95 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:52.808264 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c454f705-58f3-41b5-a30a-f01b561d7f95 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:52.808756 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c454f705-58f3-41b5-a30a-f01b561d7f95 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:52.809179 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c454f705-58f3-41b5-a30a-f01b561d7f95 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:52.945881 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-c454f705-58f3-41b5-a30a-f01b561d7f95 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:52.954545 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-c454f705-58f3-41b5-a30a-f01b561d7f95 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.159098 Aug 05 20:09:52.955344 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 367/710] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:52 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:53.021641 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-0865dd04-56de-4ab2-b314-11db77df3c25 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:53.022250 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-0865dd04-56de-4ab2-b314-11db77df3c25 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:53.029318 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0865dd04-56de-4ab2-b314-11db77df3c25 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:53.029830 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0865dd04-56de-4ab2-b314-11db77df3c25 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:53.030418 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0865dd04-56de-4ab2-b314-11db77df3c25 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:53.031232 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0865dd04-56de-4ab2-b314-11db77df3c25 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:53.031698 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0865dd04-56de-4ab2-b314-11db77df3c25 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:53.032156 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0865dd04-56de-4ab2-b314-11db77df3c25 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:53.099496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-0865dd04-56de-4ab2-b314-11db77df3c25 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:53.107299 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-0865dd04-56de-4ab2-b314-11db77df3c25 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1144 microversion: 2.1 time: 0.089417 Aug 05 20:09:53.107884 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 344/711] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:53 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1144 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:53.729428 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a308c636-c5bd-4fc4-ab3c-e1368a8713ed tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:53.730242 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a308c636-c5bd-4fc4-ab3c-e1368a8713ed tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:53.736690 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a308c636-c5bd-4fc4-ab3c-e1368a8713ed tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:53.737181 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a308c636-c5bd-4fc4-ab3c-e1368a8713ed tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:53.737617 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a308c636-c5bd-4fc4-ab3c-e1368a8713ed tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:53.738422 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a308c636-c5bd-4fc4-ab3c-e1368a8713ed tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:53.738880 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a308c636-c5bd-4fc4-ab3c-e1368a8713ed tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:53.739337 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a308c636-c5bd-4fc4-ab3c-e1368a8713ed tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:53.976594 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-ca784bb7-3e8e-47ff-ab13-412798ec4cb5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:53.977268 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-ca784bb7-3e8e-47ff-ab13-412798ec4cb5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:53.984842 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ca784bb7-3e8e-47ff-ab13-412798ec4cb5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:53.985255 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ca784bb7-3e8e-47ff-ab13-412798ec4cb5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:53.985692 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ca784bb7-3e8e-47ff-ab13-412798ec4cb5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:53.986392 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ca784bb7-3e8e-47ff-ab13-412798ec4cb5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:53.986842 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ca784bb7-3e8e-47ff-ab13-412798ec4cb5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:53.987265 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ca784bb7-3e8e-47ff-ab13-412798ec4cb5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:53.997265 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a308c636-c5bd-4fc4-ab3c-e1368a8713ed tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:54.006998 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a308c636-c5bd-4fc4-ab3c-e1368a8713ed tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:54.008490 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a308c636-c5bd-4fc4-ab3c-e1368a8713ed tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:54.009824 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a308c636-c5bd-4fc4-ab3c-e1368a8713ed tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1809 microversion: 2.20 time: 0.284849 Aug 05 20:09:54.010562 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 368/712] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:53 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1809 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:54.126850 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-ca784bb7-3e8e-47ff-ab13-412798ec4cb5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:54.128547 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-de6db447-079d-4e6b-bf3e-0040c9334dfa tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:54.129199 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-de6db447-079d-4e6b-bf3e-0040c9334dfa tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:54.136007 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de6db447-079d-4e6b-bf3e-0040c9334dfa tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:54.136206 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-ca784bb7-3e8e-47ff-ab13-412798ec4cb5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.162998 Aug 05 20:09:54.136504 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de6db447-079d-4e6b-bf3e-0040c9334dfa tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:54.136994 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de6db447-079d-4e6b-bf3e-0040c9334dfa tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:54.137705 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de6db447-079d-4e6b-bf3e-0040c9334dfa tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:54.138171 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de6db447-079d-4e6b-bf3e-0040c9334dfa tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:54.138595 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de6db447-079d-4e6b-bf3e-0040c9334dfa tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:54.146834 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 345/713] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:53 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:09:54.214744 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-de6db447-079d-4e6b-bf3e-0040c9334dfa tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:54.222512 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-de6db447-079d-4e6b-bf3e-0040c9334dfa tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1144 microversion: 2.1 time: 0.097901 Aug 05 20:09:54.223301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 369/714] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:54 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1144 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:55.033646 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-35f3ef41-a572-4cc1-b3d6-47b8b3f6f0c9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:55.034257 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-35f3ef41-a572-4cc1-b3d6-47b8b3f6f0c9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:55.041326 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-35f3ef41-a572-4cc1-b3d6-47b8b3f6f0c9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:55.041804 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-35f3ef41-a572-4cc1-b3d6-47b8b3f6f0c9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:55.042234 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-35f3ef41-a572-4cc1-b3d6-47b8b3f6f0c9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:55.042920 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-35f3ef41-a572-4cc1-b3d6-47b8b3f6f0c9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:55.043366 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-35f3ef41-a572-4cc1-b3d6-47b8b3f6f0c9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:55.043784 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-35f3ef41-a572-4cc1-b3d6-47b8b3f6f0c9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:55.158879 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-7a34bc1f-8e5f-4333-a588-cf5854c533d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:55.159450 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-7a34bc1f-8e5f-4333-a588-cf5854c533d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:55.165635 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7a34bc1f-8e5f-4333-a588-cf5854c533d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:55.166180 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7a34bc1f-8e5f-4333-a588-cf5854c533d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:55.166622 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7a34bc1f-8e5f-4333-a588-cf5854c533d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:55.167325 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7a34bc1f-8e5f-4333-a588-cf5854c533d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:55.167779 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7a34bc1f-8e5f-4333-a588-cf5854c533d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:55.168211 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7a34bc1f-8e5f-4333-a588-cf5854c533d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:55.185378 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-35f3ef41-a572-4cc1-b3d6-47b8b3f6f0c9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:55.202271 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-35f3ef41-a572-4cc1-b3d6-47b8b3f6f0c9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:55.204151 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-35f3ef41-a572-4cc1-b3d6-47b8b3f6f0c9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:55.205567 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-35f3ef41-a572-4cc1-b3d6-47b8b3f6f0c9 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1809 microversion: 2.20 time: 0.175837 Aug 05 20:09:55.206082 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 346/715] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:55 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:55.243589 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-deb0ae95-3326-4308-8575-dd4e380c3eb7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:55.244823 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-deb0ae95-3326-4308-8575-dd4e380c3eb7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:55.251500 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-deb0ae95-3326-4308-8575-dd4e380c3eb7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:55.251983 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-deb0ae95-3326-4308-8575-dd4e380c3eb7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:55.252415 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-deb0ae95-3326-4308-8575-dd4e380c3eb7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:55.253148 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-deb0ae95-3326-4308-8575-dd4e380c3eb7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:55.253594 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-deb0ae95-3326-4308-8575-dd4e380c3eb7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:55.254011 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-deb0ae95-3326-4308-8575-dd4e380c3eb7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:55.354563 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-deb0ae95-3326-4308-8575-dd4e380c3eb7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:55.358967 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-7a34bc1f-8e5f-4333-a588-cf5854c533d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:55.363173 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-deb0ae95-3326-4308-8575-dd4e380c3eb7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1144 microversion: 2.1 time: 0.123476 Aug 05 20:09:55.363926 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 347/716] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:55 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1144 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:09:55.378497 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-7a34bc1f-8e5f-4333-a588-cf5854c533d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.223901 Aug 05 20:09:55.379090 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 370/717] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:55 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:09:56.230182 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-1c5d09c5-c43b-4efa-9d73-17709970e11d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:56.230828 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-1c5d09c5-c43b-4efa-9d73-17709970e11d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:56.237186 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1c5d09c5-c43b-4efa-9d73-17709970e11d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:56.237660 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1c5d09c5-c43b-4efa-9d73-17709970e11d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:56.238085 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1c5d09c5-c43b-4efa-9d73-17709970e11d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:56.238767 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1c5d09c5-c43b-4efa-9d73-17709970e11d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:56.239211 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1c5d09c5-c43b-4efa-9d73-17709970e11d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:56.239629 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1c5d09c5-c43b-4efa-9d73-17709970e11d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:56.370530 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-1c5d09c5-c43b-4efa-9d73-17709970e11d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:56.378868 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-1c5d09c5-c43b-4efa-9d73-17709970e11d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:56.380355 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-1c5d09c5-c43b-4efa-9d73-17709970e11d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:56.381528 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-1c5d09c5-c43b-4efa-9d73-17709970e11d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1809 microversion: 2.20 time: 0.155931 Aug 05 20:09:56.382084 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 348/718] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:56 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:56.384176 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a7a6b99a-d1db-4818-b58d-4b15ee5c9595 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:56.384952 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a7a6b99a-d1db-4818-b58d-4b15ee5c9595 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:56.387044 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell0:SELECT=2 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:56.387708 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell0:SELECT=6 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:56.394612 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a7a6b99a-d1db-4818-b58d-4b15ee5c9595 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:56.395105 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a7a6b99a-d1db-4818-b58d-4b15ee5c9595 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:56.395734 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a7a6b99a-d1db-4818-b58d-4b15ee5c9595 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:56.396433 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a7a6b99a-d1db-4818-b58d-4b15ee5c9595 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:56.396925 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a7a6b99a-d1db-4818-b58d-4b15ee5c9595 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:56.397357 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a7a6b99a-d1db-4818-b58d-4b15ee5c9595 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:56.400364 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-4b3f1d38-df7d-4ccf-af35-ad32f1e14e4f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:56.401030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-4b3f1d38-df7d-4ccf-af35-ad32f1e14e4f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:56.407116 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4b3f1d38-df7d-4ccf-af35-ad32f1e14e4f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:56.407633 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4b3f1d38-df7d-4ccf-af35-ad32f1e14e4f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:56.408070 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4b3f1d38-df7d-4ccf-af35-ad32f1e14e4f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:56.408798 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4b3f1d38-df7d-4ccf-af35-ad32f1e14e4f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:56.409252 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4b3f1d38-df7d-4ccf-af35-ad32f1e14e4f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:56.409680 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4b3f1d38-df7d-4ccf-af35-ad32f1e14e4f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:56.461334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=2 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:09:56.467212 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a7a6b99a-d1db-4818-b58d-4b15ee5c9595 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:56.474703 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a7a6b99a-d1db-4818-b58d-4b15ee5c9595 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1144 microversion: 2.1 time: 0.094885 Aug 05 20:09:56.475362 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 371/719] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:56 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1144 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:09:56.556186 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-4b3f1d38-df7d-4ccf-af35-ad32f1e14e4f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:56.564011 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-4b3f1d38-df7d-4ccf-af35-ad32f1e14e4f tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.168751 Aug 05 20:09:56.564604 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 349/720] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:56 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:09:57.406252 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4eee1cd4-a10c-43e3-ac62-bbfa28f6a76b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:57.406770 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-4eee1cd4-a10c-43e3-ac62-bbfa28f6a76b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:57.413167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4eee1cd4-a10c-43e3-ac62-bbfa28f6a76b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:57.413651 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4eee1cd4-a10c-43e3-ac62-bbfa28f6a76b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:57.414084 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4eee1cd4-a10c-43e3-ac62-bbfa28f6a76b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:57.414846 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4eee1cd4-a10c-43e3-ac62-bbfa28f6a76b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:57.415541 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4eee1cd4-a10c-43e3-ac62-bbfa28f6a76b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:57.415973 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4eee1cd4-a10c-43e3-ac62-bbfa28f6a76b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:57.496031 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-fa2f5c72-81ee-4f93-b484-70459948e6cf tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:57.497075 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-fa2f5c72-81ee-4f93-b484-70459948e6cf tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:57.503297 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fa2f5c72-81ee-4f93-b484-70459948e6cf tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:57.503785 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fa2f5c72-81ee-4f93-b484-70459948e6cf tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:57.504226 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fa2f5c72-81ee-4f93-b484-70459948e6cf tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:57.505022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fa2f5c72-81ee-4f93-b484-70459948e6cf tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:57.505478 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fa2f5c72-81ee-4f93-b484-70459948e6cf tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:57.505903 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fa2f5c72-81ee-4f93-b484-70459948e6cf tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:57.553804 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-4eee1cd4-a10c-43e3-ac62-bbfa28f6a76b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:57.562857 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-4eee1cd4-a10c-43e3-ac62-bbfa28f6a76b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:57.564347 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-4eee1cd4-a10c-43e3-ac62-bbfa28f6a76b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:57.565521 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-4eee1cd4-a10c-43e3-ac62-bbfa28f6a76b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1809 microversion: 2.20 time: 0.163246 Aug 05 20:09:57.566074 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 372/721] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:57 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:57.570178 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-fa2f5c72-81ee-4f93-b484-70459948e6cf tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:57.578264 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-fa2f5c72-81ee-4f93-b484-70459948e6cf tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1144 microversion: 2.1 time: 0.086245 Aug 05 20:09:57.578824 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 350/722] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:57 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:09:57.585758 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-faef5241-9dd8-4721-9cd7-c5f75f931913 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:57.586414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-faef5241-9dd8-4721-9cd7-c5f75f931913 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:57.592972 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-faef5241-9dd8-4721-9cd7-c5f75f931913 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:57.593452 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-faef5241-9dd8-4721-9cd7-c5f75f931913 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:57.593886 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-faef5241-9dd8-4721-9cd7-c5f75f931913 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:57.594565 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-faef5241-9dd8-4721-9cd7-c5f75f931913 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:57.595013 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-faef5241-9dd8-4721-9cd7-c5f75f931913 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:57.595439 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-faef5241-9dd8-4721-9cd7-c5f75f931913 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:57.728075 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-faef5241-9dd8-4721-9cd7-c5f75f931913 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:57.737106 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-faef5241-9dd8-4721-9cd7-c5f75f931913 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.154990 Aug 05 20:09:57.737682 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 373/723] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:57 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:58.589193 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a3b56a3a-8699-4a72-9e02-e6fd444aa6e5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:58.589770 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-a3b56a3a-8699-4a72-9e02-e6fd444aa6e5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:58.596343 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a3b56a3a-8699-4a72-9e02-e6fd444aa6e5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:58.596856 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a3b56a3a-8699-4a72-9e02-e6fd444aa6e5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:58.597293 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a3b56a3a-8699-4a72-9e02-e6fd444aa6e5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:58.597985 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a3b56a3a-8699-4a72-9e02-e6fd444aa6e5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:58.598432 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a3b56a3a-8699-4a72-9e02-e6fd444aa6e5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:58.598846 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a3b56a3a-8699-4a72-9e02-e6fd444aa6e5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:58.599042 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-5a5e25ef-9bf4-4ba4-a10b-f5fe6592eebc tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:58.599658 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-5a5e25ef-9bf4-4ba4-a10b-f5fe6592eebc tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:58.606813 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5a5e25ef-9bf4-4ba4-a10b-f5fe6592eebc tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:58.607296 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5a5e25ef-9bf4-4ba4-a10b-f5fe6592eebc tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:58.607732 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5a5e25ef-9bf4-4ba4-a10b-f5fe6592eebc tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:58.608420 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5a5e25ef-9bf4-4ba4-a10b-f5fe6592eebc tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:58.608911 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5a5e25ef-9bf4-4ba4-a10b-f5fe6592eebc tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:58.609339 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5a5e25ef-9bf4-4ba4-a10b-f5fe6592eebc tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:58.684147 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-5a5e25ef-9bf4-4ba4-a10b-f5fe6592eebc tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:58.691433 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-5a5e25ef-9bf4-4ba4-a10b-f5fe6592eebc tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1144 microversion: 2.1 time: 0.096297 Aug 05 20:09:58.692002 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 374/724] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:58 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1144 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:09:58.751981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a3b56a3a-8699-4a72-9e02-e6fd444aa6e5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:58.758070 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-bf36c356-d1eb-43a7-b365-a7d518bbfaad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:58.759244 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-bf36c356-d1eb-43a7-b365-a7d518bbfaad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:58.761464 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a3b56a3a-8699-4a72-9e02-e6fd444aa6e5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:58.762975 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a3b56a3a-8699-4a72-9e02-e6fd444aa6e5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:58.764133 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-a3b56a3a-8699-4a72-9e02-e6fd444aa6e5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1809 microversion: 2.20 time: 0.179590 Aug 05 20:09:58.764715 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 351/725] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:58 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:09:58.765499 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-bf36c356-d1eb-43a7-b365-a7d518bbfaad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:58.765985 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-bf36c356-d1eb-43a7-b365-a7d518bbfaad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:58.766418 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-bf36c356-d1eb-43a7-b365-a7d518bbfaad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:58.767107 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-bf36c356-d1eb-43a7-b365-a7d518bbfaad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:58.767557 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-bf36c356-d1eb-43a7-b365-a7d518bbfaad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:58.767984 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-bf36c356-d1eb-43a7-b365-a7d518bbfaad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:58.898217 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-bf36c356-d1eb-43a7-b365-a7d518bbfaad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:58.906845 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-bf36c356-d1eb-43a7-b365-a7d518bbfaad tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.152521 Aug 05 20:09:58.907408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 375/726] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:58 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:09:59.712257 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-0754bd88-e3f1-4f49-9d8c-6f1b234883f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:59.712906 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-0754bd88-e3f1-4f49-9d8c-6f1b234883f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:59.719322 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0754bd88-e3f1-4f49-9d8c-6f1b234883f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:59.719815 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0754bd88-e3f1-4f49-9d8c-6f1b234883f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:59.720249 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0754bd88-e3f1-4f49-9d8c-6f1b234883f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:59.720968 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0754bd88-e3f1-4f49-9d8c-6f1b234883f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:59.721425 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0754bd88-e3f1-4f49-9d8c-6f1b234883f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:59.721853 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0754bd88-e3f1-4f49-9d8c-6f1b234883f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:59.783901 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-0754bd88-e3f1-4f49-9d8c-6f1b234883f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:59.787390 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-3274660c-9bbe-454d-b7c8-86d742838b25 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:59.787994 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-3274660c-9bbe-454d-b7c8-86d742838b25 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:59.792101 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-0754bd88-e3f1-4f49-9d8c-6f1b234883f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1192 microversion: 2.1 time: 0.083653 Aug 05 20:09:59.792700 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 352/727] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:59 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:09:59.795263 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3274660c-9bbe-454d-b7c8-86d742838b25 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:59.795743 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3274660c-9bbe-454d-b7c8-86d742838b25 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:59.796183 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3274660c-9bbe-454d-b7c8-86d742838b25 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:59.796891 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3274660c-9bbe-454d-b7c8-86d742838b25 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:59.797340 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3274660c-9bbe-454d-b7c8-86d742838b25 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:59.797764 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3274660c-9bbe-454d-b7c8-86d742838b25 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:59.928852 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7f8bc5d7-1f65-4376-9a83-abd64b57898a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:09:59.929486 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-7f8bc5d7-1f65-4376-9a83-abd64b57898a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:09:59.929694 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-3274660c-9bbe-454d-b7c8-86d742838b25 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:59.936710 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7f8bc5d7-1f65-4376-9a83-abd64b57898a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:59.937396 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7f8bc5d7-1f65-4376-9a83-abd64b57898a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:59.937842 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7f8bc5d7-1f65-4376-9a83-abd64b57898a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:59.938555 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7f8bc5d7-1f65-4376-9a83-abd64b57898a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:09:59.939016 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7f8bc5d7-1f65-4376-9a83-abd64b57898a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:09:59.939442 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7f8bc5d7-1f65-4376-9a83-abd64b57898a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:09:59.939871 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-3274660c-9bbe-454d-b7c8-86d742838b25 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:59.941591 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-3274660c-9bbe-454d-b7c8-86d742838b25 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:09:59.942937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-3274660c-9bbe-454d-b7c8-86d742838b25 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1809 microversion: 2.20 time: 0.159352 Aug 05 20:09:59.945052 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 376/728] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:09:59 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:10:00.085234 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-7f8bc5d7-1f65-4376-9a83-abd64b57898a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:00.094278 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-7f8bc5d7-1f65-4376-9a83-abd64b57898a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.170110 Aug 05 20:10:00.094846 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 353/729] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:09:59 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:00.818119 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-48ff25dd-efb0-4bc3-bfee-acbc323fb0e8 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:00.818743 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-48ff25dd-efb0-4bc3-bfee-acbc323fb0e8 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:00.825914 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-48ff25dd-efb0-4bc3-bfee-acbc323fb0e8 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:00.826398 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-48ff25dd-efb0-4bc3-bfee-acbc323fb0e8 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:00.826828 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-48ff25dd-efb0-4bc3-bfee-acbc323fb0e8 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:00.827509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-48ff25dd-efb0-4bc3-bfee-acbc323fb0e8 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:00.827955 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-48ff25dd-efb0-4bc3-bfee-acbc323fb0e8 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:00.828380 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-48ff25dd-efb0-4bc3-bfee-acbc323fb0e8 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:00.892703 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-48ff25dd-efb0-4bc3-bfee-acbc323fb0e8 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:00.894906 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=100 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:00.901796 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-48ff25dd-efb0-4bc3-bfee-acbc323fb0e8 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1192 microversion: 2.1 time: 0.087498 Aug 05 20:10:00.902359 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 377/730] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:00 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:00.966396 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3f0cd449-16ca-4ca2-a252-8975a1f26f06 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:00.967130 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-3f0cd449-16ca-4ca2-a252-8975a1f26f06 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:00.973455 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3f0cd449-16ca-4ca2-a252-8975a1f26f06 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:00.973936 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3f0cd449-16ca-4ca2-a252-8975a1f26f06 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:00.974365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3f0cd449-16ca-4ca2-a252-8975a1f26f06 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:00.975042 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3f0cd449-16ca-4ca2-a252-8975a1f26f06 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:00.975520 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3f0cd449-16ca-4ca2-a252-8975a1f26f06 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:00.975936 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3f0cd449-16ca-4ca2-a252-8975a1f26f06 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:01.105229 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3f0cd449-16ca-4ca2-a252-8975a1f26f06 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:01.116306 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3f0cd449-16ca-4ca2-a252-8975a1f26f06 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:01.116306 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3f0cd449-16ca-4ca2-a252-8975a1f26f06 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:01.116631 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a969efa6-8376-4364-811d-6a73adcff93c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:01.116735 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3f0cd449-16ca-4ca2-a252-8975a1f26f06 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1809 microversion: 2.20 time: 0.153811 Aug 05 20:10:01.116821 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a969efa6-8376-4364-811d-6a73adcff93c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:01.123266 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a969efa6-8376-4364-811d-6a73adcff93c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:01.123759 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a969efa6-8376-4364-811d-6a73adcff93c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:01.124202 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a969efa6-8376-4364-811d-6a73adcff93c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:01.124935 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a969efa6-8376-4364-811d-6a73adcff93c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:01.125397 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a969efa6-8376-4364-811d-6a73adcff93c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:01.125828 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a969efa6-8376-4364-811d-6a73adcff93c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:01.129662 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 354/731] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:00 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:01.261644 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a969efa6-8376-4364-811d-6a73adcff93c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:01.269887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a969efa6-8376-4364-811d-6a73adcff93c tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.157827 Aug 05 20:10:01.270446 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 378/732] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:01 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:01.922823 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-ec4bb136-9cc4-4c5b-afbf-0765b3f4ef0d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:01.923466 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-ec4bb136-9cc4-4c5b-afbf-0765b3f4ef0d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:01.929421 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ec4bb136-9cc4-4c5b-afbf-0765b3f4ef0d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:01.929901 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ec4bb136-9cc4-4c5b-afbf-0765b3f4ef0d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:01.930968 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ec4bb136-9cc4-4c5b-afbf-0765b3f4ef0d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:01.931649 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ec4bb136-9cc4-4c5b-afbf-0765b3f4ef0d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:01.932094 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ec4bb136-9cc4-4c5b-afbf-0765b3f4ef0d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:01.932514 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ec4bb136-9cc4-4c5b-afbf-0765b3f4ef0d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:01.934999 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=100 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:01.994395 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-ec4bb136-9cc4-4c5b-afbf-0765b3f4ef0d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:02.001678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-ec4bb136-9cc4-4c5b-afbf-0765b3f4ef0d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1200 microversion: 2.1 time: 0.082675 Aug 05 20:10:02.002240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 355/733] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:01 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1200 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:02.139604 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b1e2151c-e02f-4b90-8f39-0ed55d2f9b18 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:02.140220 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-b1e2151c-e02f-4b90-8f39-0ed55d2f9b18 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:02.146678 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b1e2151c-e02f-4b90-8f39-0ed55d2f9b18 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:02.147161 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b1e2151c-e02f-4b90-8f39-0ed55d2f9b18 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:02.147596 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b1e2151c-e02f-4b90-8f39-0ed55d2f9b18 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:02.148286 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b1e2151c-e02f-4b90-8f39-0ed55d2f9b18 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:02.149276 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b1e2151c-e02f-4b90-8f39-0ed55d2f9b18 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:02.150343 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b1e2151c-e02f-4b90-8f39-0ed55d2f9b18 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:02.280090 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-b1e2151c-e02f-4b90-8f39-0ed55d2f9b18 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:02.288564 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-b1e2151c-e02f-4b90-8f39-0ed55d2f9b18 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:02.290741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-b1e2151c-e02f-4b90-8f39-0ed55d2f9b18 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:02.291758 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-27df32e4-8ec6-41a3-b990-9f470feb34c8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:02.291894 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b1e2151c-e02f-4b90-8f39-0ed55d2f9b18 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1809 microversion: 2.20 time: 0.156501 Aug 05 20:10:02.292627 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-27df32e4-8ec6-41a3-b990-9f470feb34c8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:02.292758 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 379/734] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:02 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:02.298283 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-27df32e4-8ec6-41a3-b990-9f470feb34c8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:02.298762 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-27df32e4-8ec6-41a3-b990-9f470feb34c8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:02.299197 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-27df32e4-8ec6-41a3-b990-9f470feb34c8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:02.299890 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-27df32e4-8ec6-41a3-b990-9f470feb34c8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:02.300343 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-27df32e4-8ec6-41a3-b990-9f470feb34c8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:02.300807 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-27df32e4-8ec6-41a3-b990-9f470feb34c8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:02.428696 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-27df32e4-8ec6-41a3-b990-9f470feb34c8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:02.436856 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-27df32e4-8ec6-41a3-b990-9f470feb34c8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.149474 Aug 05 20:10:02.437402 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 356/735] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:02 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:03.022746 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-69d3d975-2528-47fa-85cd-ef1f2162b1a1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:03.023361 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-69d3d975-2528-47fa-85cd-ef1f2162b1a1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:03.029712 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-69d3d975-2528-47fa-85cd-ef1f2162b1a1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:03.030205 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-69d3d975-2528-47fa-85cd-ef1f2162b1a1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:03.030645 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-69d3d975-2528-47fa-85cd-ef1f2162b1a1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:03.031338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-69d3d975-2528-47fa-85cd-ef1f2162b1a1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:03.031804 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-69d3d975-2528-47fa-85cd-ef1f2162b1a1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:03.032234 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-69d3d975-2528-47fa-85cd-ef1f2162b1a1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:03.092078 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-69d3d975-2528-47fa-85cd-ef1f2162b1a1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:03.099399 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-69d3d975-2528-47fa-85cd-ef1f2162b1a1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1200 microversion: 2.1 time: 0.080547 Aug 05 20:10:03.099961 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 380/736] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:03 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1200 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:03.314732 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-5c771de2-f2e9-446b-92c1-5837659739a5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:03.315262 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-5c771de2-f2e9-446b-92c1-5837659739a5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:03.321840 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5c771de2-f2e9-446b-92c1-5837659739a5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:03.322322 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5c771de2-f2e9-446b-92c1-5837659739a5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:03.322762 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5c771de2-f2e9-446b-92c1-5837659739a5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:03.323450 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5c771de2-f2e9-446b-92c1-5837659739a5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:03.323913 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5c771de2-f2e9-446b-92c1-5837659739a5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:03.324339 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5c771de2-f2e9-446b-92c1-5837659739a5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:03.452920 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-5c771de2-f2e9-446b-92c1-5837659739a5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:03.458304 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-cd71e6ff-77b5-4ee0-ba7c-6928ecf86e64 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:03.458925 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-cd71e6ff-77b5-4ee0-ba7c-6928ecf86e64 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:03.461483 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:03.461709 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-5c771de2-f2e9-446b-92c1-5837659739a5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:03.462996 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-5c771de2-f2e9-446b-92c1-5837659739a5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:03.464168 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-5c771de2-f2e9-446b-92c1-5837659739a5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1809 microversion: 2.20 time: 0.153385 Aug 05 20:10:03.464959 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 357/737] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:03 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:03.466446 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cd71e6ff-77b5-4ee0-ba7c-6928ecf86e64 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:03.466938 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cd71e6ff-77b5-4ee0-ba7c-6928ecf86e64 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:03.467385 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cd71e6ff-77b5-4ee0-ba7c-6928ecf86e64 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:03.468062 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cd71e6ff-77b5-4ee0-ba7c-6928ecf86e64 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:03.468519 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cd71e6ff-77b5-4ee0-ba7c-6928ecf86e64 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:03.468968 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cd71e6ff-77b5-4ee0-ba7c-6928ecf86e64 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:03.604554 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-cd71e6ff-77b5-4ee0-ba7c-6928ecf86e64 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:03.612410 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-cd71e6ff-77b5-4ee0-ba7c-6928ecf86e64 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.157908 Aug 05 20:10:03.613000 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 381/738] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:03 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:04.119273 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-5458bcd1-f266-4ab2-b249-f2dd46549c47 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:04.119908 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-5458bcd1-f266-4ab2-b249-f2dd46549c47 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:04.125809 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5458bcd1-f266-4ab2-b249-f2dd46549c47 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:04.126291 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5458bcd1-f266-4ab2-b249-f2dd46549c47 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:04.126724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5458bcd1-f266-4ab2-b249-f2dd46549c47 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:04.127399 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5458bcd1-f266-4ab2-b249-f2dd46549c47 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:04.127846 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5458bcd1-f266-4ab2-b249-f2dd46549c47 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:04.128268 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5458bcd1-f266-4ab2-b249-f2dd46549c47 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:04.190322 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-5458bcd1-f266-4ab2-b249-f2dd46549c47 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:04.198085 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-5458bcd1-f266-4ab2-b249-f2dd46549c47 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1210 microversion: 2.1 time: 0.082673 Aug 05 20:10:04.198658 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 358/739] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:04 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:04.487412 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-8df544fe-1a33-4b7f-99ba-ebec3502a816 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:04.487929 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-8df544fe-1a33-4b7f-99ba-ebec3502a816 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:04.494795 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8df544fe-1a33-4b7f-99ba-ebec3502a816 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:04.495281 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8df544fe-1a33-4b7f-99ba-ebec3502a816 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:04.495711 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8df544fe-1a33-4b7f-99ba-ebec3502a816 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:04.496398 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8df544fe-1a33-4b7f-99ba-ebec3502a816 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:04.496870 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8df544fe-1a33-4b7f-99ba-ebec3502a816 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:04.497290 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8df544fe-1a33-4b7f-99ba-ebec3502a816 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:04.627688 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-8df544fe-1a33-4b7f-99ba-ebec3502a816 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:04.634721 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3b1053f5-a381-431b-a36f-55a792fc0932 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:04.635607 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-3b1053f5-a381-431b-a36f-55a792fc0932 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:04.637317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-8df544fe-1a33-4b7f-99ba-ebec3502a816 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:04.638840 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-8df544fe-1a33-4b7f-99ba-ebec3502a816 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:04.640038 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-8df544fe-1a33-4b7f-99ba-ebec3502a816 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1809 microversion: 2.20 time: 0.156552 Aug 05 20:10:04.640919 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 382/740] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:04 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:04.642028 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3b1053f5-a381-431b-a36f-55a792fc0932 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:04.642520 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3b1053f5-a381-431b-a36f-55a792fc0932 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:04.642955 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3b1053f5-a381-431b-a36f-55a792fc0932 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:04.643654 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3b1053f5-a381-431b-a36f-55a792fc0932 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:04.644166 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3b1053f5-a381-431b-a36f-55a792fc0932 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:04.644642 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3b1053f5-a381-431b-a36f-55a792fc0932 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:04.776849 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3b1053f5-a381-431b-a36f-55a792fc0932 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:04.785665 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3b1053f5-a381-431b-a36f-55a792fc0932 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.155693 Aug 05 20:10:04.786242 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 359/741] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:04 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:05.220039 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4d0cc7cd-3e19-4d2e-ae4a-9584c81fdf7e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:05.220794 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-4d0cc7cd-3e19-4d2e-ae4a-9584c81fdf7e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:05.227001 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4d0cc7cd-3e19-4d2e-ae4a-9584c81fdf7e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:05.227706 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4d0cc7cd-3e19-4d2e-ae4a-9584c81fdf7e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:05.228153 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4d0cc7cd-3e19-4d2e-ae4a-9584c81fdf7e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:05.228928 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4d0cc7cd-3e19-4d2e-ae4a-9584c81fdf7e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:05.229399 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4d0cc7cd-3e19-4d2e-ae4a-9584c81fdf7e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:05.229842 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4d0cc7cd-3e19-4d2e-ae4a-9584c81fdf7e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:05.378385 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-4d0cc7cd-3e19-4d2e-ae4a-9584c81fdf7e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:05.387327 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-4d0cc7cd-3e19-4d2e-ae4a-9584c81fdf7e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1210 microversion: 2.1 time: 0.171690 Aug 05 20:10:05.387903 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 383/742] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:05 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1210 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:05.667952 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-d0596cfd-a1df-4843-865a-e2380c19d546 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:05.668649 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-d0596cfd-a1df-4843-865a-e2380c19d546 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:05.676111 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d0596cfd-a1df-4843-865a-e2380c19d546 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:05.676855 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d0596cfd-a1df-4843-865a-e2380c19d546 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:05.677440 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d0596cfd-a1df-4843-865a-e2380c19d546 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:05.678143 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d0596cfd-a1df-4843-865a-e2380c19d546 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:05.678603 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d0596cfd-a1df-4843-865a-e2380c19d546 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:05.679026 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d0596cfd-a1df-4843-865a-e2380c19d546 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:05.807556 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-f83f9f4a-aa92-4538-ac00-a75b5bfbfa04 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:05.808282 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-f83f9f4a-aa92-4538-ac00-a75b5bfbfa04 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:05.814539 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f83f9f4a-aa92-4538-ac00-a75b5bfbfa04 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:05.815019 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f83f9f4a-aa92-4538-ac00-a75b5bfbfa04 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:05.815455 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f83f9f4a-aa92-4538-ac00-a75b5bfbfa04 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:05.816151 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f83f9f4a-aa92-4538-ac00-a75b5bfbfa04 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:05.816617 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f83f9f4a-aa92-4538-ac00-a75b5bfbfa04 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:05.817043 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f83f9f4a-aa92-4538-ac00-a75b5bfbfa04 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:05.946641 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-d0596cfd-a1df-4843-865a-e2380c19d546 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:05.955371 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-d0596cfd-a1df-4843-865a-e2380c19d546 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:05.957026 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-d0596cfd-a1df-4843-865a-e2380c19d546 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:05.958191 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-d0596cfd-a1df-4843-865a-e2380c19d546 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1809 microversion: 2.20 time: 0.297527 Aug 05 20:10:05.958762 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 360/743] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:05 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1809 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:06.074688 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-f83f9f4a-aa92-4538-ac00-a75b5bfbfa04 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:06.094722 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-f83f9f4a-aa92-4538-ac00-a75b5bfbfa04 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.291324 Aug 05 20:10:06.108487 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 384/744] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:05 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:06.407344 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-518bb0a3-7629-4716-ae8a-2ad3a7e51701 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:06.407965 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-518bb0a3-7629-4716-ae8a-2ad3a7e51701 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:06.414680 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-518bb0a3-7629-4716-ae8a-2ad3a7e51701 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:06.415424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-518bb0a3-7629-4716-ae8a-2ad3a7e51701 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:06.415985 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-518bb0a3-7629-4716-ae8a-2ad3a7e51701 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:06.416712 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-518bb0a3-7629-4716-ae8a-2ad3a7e51701 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:06.417171 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-518bb0a3-7629-4716-ae8a-2ad3a7e51701 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:06.417599 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-518bb0a3-7629-4716-ae8a-2ad3a7e51701 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:06.621545 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-518bb0a3-7629-4716-ae8a-2ad3a7e51701 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:06.628983 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-518bb0a3-7629-4716-ae8a-2ad3a7e51701 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1278 microversion: 2.1 time: 0.225433 Aug 05 20:10:06.629559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 361/745] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:06 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1278 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:06.984615 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-08fffbf0-c95c-4068-82ee-a397ea789d5d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:06.986118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-08fffbf0-c95c-4068-82ee-a397ea789d5d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:06.995168 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-08fffbf0-c95c-4068-82ee-a397ea789d5d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:06.995755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-08fffbf0-c95c-4068-82ee-a397ea789d5d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:06.996348 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-08fffbf0-c95c-4068-82ee-a397ea789d5d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:06.997276 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-08fffbf0-c95c-4068-82ee-a397ea789d5d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:06.997734 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-08fffbf0-c95c-4068-82ee-a397ea789d5d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:06.998184 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-08fffbf0-c95c-4068-82ee-a397ea789d5d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:07.120697 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-9fca64ba-df7f-4b87-b6d9-c31732c817ca req-833bfe08-7ddc-4fb4-9776-afccedd8506c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98e6fc07-61b1-455d-8bf0-563c5debbebb", "name": "network-vif-plugged", "status": "completed", "tag": "e1afce7c-4bdd-432b-905f-443b0227fa80"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:07.131984 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-9fca64ba-df7f-4b87-b6d9-c31732c817ca req-833bfe08-7ddc-4fb4-9776-afccedd8506c service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:07.132463 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-9fca64ba-df7f-4b87-b6d9-c31732c817ca req-833bfe08-7ddc-4fb4-9776-afccedd8506c service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:07.133102 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-9fca64ba-df7f-4b87-b6d9-c31732c817ca req-833bfe08-7ddc-4fb4-9776-afccedd8506c service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:07.151991 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-9fca64ba-df7f-4b87-b6d9-c31732c817ca req-833bfe08-7ddc-4fb4-9776-afccedd8506c service nova] Creating event network-vif-plugged:e1afce7c-4bdd-432b-905f-443b0227fa80 for instance 98e6fc07-61b1-455d-8bf0-563c5debbebb on hv-cinder-85221 Aug 05 20:10:07.157619 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-9fca64ba-df7f-4b87-b6d9-c31732c817ca req-833bfe08-7ddc-4fb4-9776-afccedd8506c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047461 Aug 05 20:10:07.158279 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 362/746] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:10:07.163877 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a280b6e1-74c1-4342-b5ae-a2ba6aff2da2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:07.164879 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-a280b6e1-74c1-4342-b5ae-a2ba6aff2da2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:07.171743 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a280b6e1-74c1-4342-b5ae-a2ba6aff2da2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:07.172173 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a280b6e1-74c1-4342-b5ae-a2ba6aff2da2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:07.172653 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a280b6e1-74c1-4342-b5ae-a2ba6aff2da2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:07.173351 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a280b6e1-74c1-4342-b5ae-a2ba6aff2da2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:07.173807 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a280b6e1-74c1-4342-b5ae-a2ba6aff2da2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:07.174236 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a280b6e1-74c1-4342-b5ae-a2ba6aff2da2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:07.211803 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-08fffbf0-c95c-4068-82ee-a397ea789d5d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:07.228681 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-08fffbf0-c95c-4068-82ee-a397ea789d5d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:07.230270 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-08fffbf0-c95c-4068-82ee-a397ea789d5d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:07.231363 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-08fffbf0-c95c-4068-82ee-a397ea789d5d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1809 microversion: 2.20 time: 0.252699 Aug 05 20:10:07.231935 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 385/747] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:06 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1809 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:07.252251 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-030016d3-a166-449f-bebc-291fd00c0d4f req-c4a3c499-8643-412f-9f32-23831e4a1e9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "412b5860-2133-41f8-8960-b3f068a8f11f", "tag": "0a61f0d0-34bf-488d-a986-3ba8db0d4db6"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:07.262594 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-030016d3-a166-449f-bebc-291fd00c0d4f req-c4a3c499-8643-412f-9f32-23831e4a1e9e service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:07.263075 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-030016d3-a166-449f-bebc-291fd00c0d4f req-c4a3c499-8643-412f-9f32-23831e4a1e9e service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:07.263503 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-030016d3-a166-449f-bebc-291fd00c0d4f req-c4a3c499-8643-412f-9f32-23831e4a1e9e service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:07.275358 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-030016d3-a166-449f-bebc-291fd00c0d4f req-c4a3c499-8643-412f-9f32-23831e4a1e9e service nova] Creating event network-changed:0a61f0d0-34bf-488d-a986-3ba8db0d4db6 for instance 412b5860-2133-41f8-8960-b3f068a8f11f on hv-cinder-85221 Aug 05 20:10:07.280704 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-030016d3-a166-449f-bebc-291fd00c0d4f req-c4a3c499-8643-412f-9f32-23831e4a1e9e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032063 Aug 05 20:10:07.281513 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 386/748] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:10:07.380959 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a280b6e1-74c1-4342-b5ae-a2ba6aff2da2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:07.389557 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-a280b6e1-74c1-4342-b5ae-a2ba6aff2da2 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1736 microversion: 2.1 time: 0.230176 Aug 05 20:10:07.390161 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 363/749] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:07 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:07.651895 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-f0ae9bdc-fb29-4ad3-b04e-405c148df625 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:07.652516 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-f0ae9bdc-fb29-4ad3-b04e-405c148df625 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:07.659064 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f0ae9bdc-fb29-4ad3-b04e-405c148df625 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:07.659556 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f0ae9bdc-fb29-4ad3-b04e-405c148df625 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:07.659994 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f0ae9bdc-fb29-4ad3-b04e-405c148df625 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:07.660737 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f0ae9bdc-fb29-4ad3-b04e-405c148df625 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:07.661197 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f0ae9bdc-fb29-4ad3-b04e-405c148df625 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:07.661625 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f0ae9bdc-fb29-4ad3-b04e-405c148df625 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:07.801344 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-f0ae9bdc-fb29-4ad3-b04e-405c148df625 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:07.810670 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-f0ae9bdc-fb29-4ad3-b04e-405c148df625 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1266 microversion: 2.1 time: 0.164189 Aug 05 20:10:07.811487 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 387/750] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:07 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:08.259073 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-6387dc18-c958-4128-b3b2-664fa025aaa2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:08.260598 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-6387dc18-c958-4128-b3b2-664fa025aaa2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:08.267929 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6387dc18-c958-4128-b3b2-664fa025aaa2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:08.268422 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6387dc18-c958-4128-b3b2-664fa025aaa2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:08.268894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6387dc18-c958-4128-b3b2-664fa025aaa2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:08.269599 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6387dc18-c958-4128-b3b2-664fa025aaa2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:08.270086 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6387dc18-c958-4128-b3b2-664fa025aaa2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:08.270801 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6387dc18-c958-4128-b3b2-664fa025aaa2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:08.413274 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-6387dc18-c958-4128-b3b2-664fa025aaa2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:08.415248 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-50a53349-6145-47e0-a4bd-dafec9d61f44 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:08.416300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-50a53349-6145-47e0-a4bd-dafec9d61f44 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:08.426186 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-50a53349-6145-47e0-a4bd-dafec9d61f44 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:08.426978 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-50a53349-6145-47e0-a4bd-dafec9d61f44 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:08.427665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-50a53349-6145-47e0-a4bd-dafec9d61f44 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:08.428820 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-50a53349-6145-47e0-a4bd-dafec9d61f44 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:08.428923 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-6387dc18-c958-4128-b3b2-664fa025aaa2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:08.429608 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-50a53349-6145-47e0-a4bd-dafec9d61f44 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:08.430897 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-50a53349-6145-47e0-a4bd-dafec9d61f44 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:08.432932 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-6387dc18-c958-4128-b3b2-664fa025aaa2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:08.434942 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-6387dc18-c958-4128-b3b2-664fa025aaa2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1809 microversion: 2.20 time: 0.183104 Aug 05 20:10:08.435877 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 364/751] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:08 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:08.568088 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-50a53349-6145-47e0-a4bd-dafec9d61f44 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:08.577898 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-50a53349-6145-47e0-a4bd-dafec9d61f44 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1716 microversion: 2.1 time: 0.170241 Aug 05 20:10:08.578465 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 388/752] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:08 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1716 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:08.640195 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-cfa40c2b-94f4-4470-ac04-42b268166be0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:08.640790 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-cfa40c2b-94f4-4470-ac04-42b268166be0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:08.646943 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cfa40c2b-94f4-4470-ac04-42b268166be0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:08.647431 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cfa40c2b-94f4-4470-ac04-42b268166be0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:08.647906 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cfa40c2b-94f4-4470-ac04-42b268166be0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:08.649325 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cfa40c2b-94f4-4470-ac04-42b268166be0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:08.649784 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cfa40c2b-94f4-4470-ac04-42b268166be0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:08.650210 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cfa40c2b-94f4-4470-ac04-42b268166be0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:08.735340 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-cfa40c2b-94f4-4470-ac04-42b268166be0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] HTTP exception thrown: Cannot 'detach_volume' instance 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 while it is in vm_state rescued Aug 05 20:10:08.737119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-cfa40c2b-94f4-4470-ac04-42b268166be0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Request method failure captured: Aug 05 20:10:08.737119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: DELETE /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1/os-volume_attachments/0efc580c-295e-4061-aedc-195f049f7f1e HTTP/1.1 Aug 05 20:10:08.737119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:10:08.737119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:10:08.737119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:10:08.737119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:10:08.737119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:10:08.737119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:10:08.737119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:10:08.737119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:10:08.737119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XdnvYt02KSUfuGZ4aMCLRd8A9W_4ugESxync32oagoq2m1bRquV2YcYbZy923ze2HKyg5orLp5ZPgQwQNpL1ZwXjKJN6rbHklb_4GvGBhZZEq-4iAyROqoLvdfOlApZwfRc8nLpUC3uM58ekKbcVuoIhI3WM4aUZiobfffRTVMm8jY Aug 05 20:10:08.737119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:10:08.737119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:10:08.737119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:10:08.737119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:10:08.737119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:10:08.737119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:10:08.737119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: c5b5718607784ec9be3289f7916f70a6 Aug 05 20:10:08.737119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1357645261 Aug 05 20:10:08.737119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:10:08.737119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:10:08.738818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c5b5718607784ec9be3289f7916f70a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c5b5718607784ec9be3289f7916f70a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c5b5718607784ec9be3289f7916f70a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c5b5718607784ec9be3289f7916f70a6", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:10:08.738818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1357645261 Aug 05 20:10:08.738818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: c5b5718607784ec9be3289f7916f70a6 Aug 05 20:10:08.738818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1357645261 Aug 05 20:10:08.738818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-ServerRescueNegativeTestJSON-1357645261-project Aug 05 20:10:08.738818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:10:08.738818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:10:08.738818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: 293b8a62f19c45c1bf5b897c7cf40edb Aug 05 20:10:08.738818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1357645261-project Aug 05 20:10:08.738818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: > Aug 05 20:10:08.738818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Cannot 'detach_volume' instance 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 while it is in vm_state rescued Aug 05 20:10:08.739678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'server_id': '96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1', 'id': '0efc580c-295e-4061-aedc-195f049f7f1e'} Aug 05 20:10:08.739678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:10:08.739678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:10:08.739678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 05 20:10:08.739678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 05 20:10:08.739678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 20:10:08.739678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 20:10:08.739678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 05 20:10:08.739678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 05 20:10:08.739678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 05 20:10:08.739678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:10:08.739678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:10:08.739678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:10:08.739678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:10:08.739678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:10:08.739678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:10:08.739678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:10:08.739678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:10:08.739678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:10:08.739678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:10:08.741300 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 05 20:10:08.741300 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 05 20:10:08.741300 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 05 20:10:08.741300 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 05 20:10:08.741300 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 while it is in vm_state rescued Aug 05 20:10:08.741300 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:10:08.741300 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:10:08.741300 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:10:08.741300 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:10:08.741300 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:10:08.741300 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:10:08.741300 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:10:08.741300 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:10:08.741300 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 while it is in vm_state rescued Aug 05 20:10:08.741300 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:10:08.741300 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-cfa40c2b-94f4-4470-ac04-42b268166be0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Returning 409 to user: Cannot 'detach_volume' instance 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 while it is in vm_state rescued {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:10:08.742670 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-cfa40c2b-94f4-4470-ac04-42b268166be0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "DELETE /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1/os-volume_attachments/0efc580c-295e-4061-aedc-195f049f7f1e" status: 409 len: 152 microversion: 2.1 time: 0.103648 Aug 05 20:10:08.742670 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 365/753] 10.222.0.39 () {58 vars in 1416 bytes} [Fri Aug 5 20:10:08 2022] DELETE /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1/os-volume_attachments/0efc580c-295e-4061-aedc-195f049f7f1e => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 05 20:10:08.747665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-c6bd1778-aeb7-44b6-b8f5-b0774485c3f9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:08.748236 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-c6bd1778-aeb7-44b6-b8f5-b0774485c3f9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:08.754204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c6bd1778-aeb7-44b6-b8f5-b0774485c3f9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:08.754695 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c6bd1778-aeb7-44b6-b8f5-b0774485c3f9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:08.755134 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c6bd1778-aeb7-44b6-b8f5-b0774485c3f9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:08.755828 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c6bd1778-aeb7-44b6-b8f5-b0774485c3f9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:08.756286 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c6bd1778-aeb7-44b6-b8f5-b0774485c3f9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:08.756784 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c6bd1778-aeb7-44b6-b8f5-b0774485c3f9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:08.825407 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-c6bd1778-aeb7-44b6-b8f5-b0774485c3f9 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "POST /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1/action" status: 202 len: 0 microversion: 2.1 time: 0.081433 Aug 05 20:10:08.828991 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 389/754] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Aug 5 20:10:08 2022] POST /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:10:08.831776 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-8675e629-49db-44fd-b6a6-f689ef3cbc06 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:08.832477 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-8675e629-49db-44fd-b6a6-f689ef3cbc06 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:08.834338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-6ae76423-0fdf-4aca-ae65-38b530fcf866 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:08.835047 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-6ae76423-0fdf-4aca-ae65-38b530fcf866 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:08.839689 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8675e629-49db-44fd-b6a6-f689ef3cbc06 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:08.840181 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8675e629-49db-44fd-b6a6-f689ef3cbc06 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:08.840645 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8675e629-49db-44fd-b6a6-f689ef3cbc06 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:08.841131 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6ae76423-0fdf-4aca-ae65-38b530fcf866 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:08.841374 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8675e629-49db-44fd-b6a6-f689ef3cbc06 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:08.841638 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6ae76423-0fdf-4aca-ae65-38b530fcf866 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:08.841802 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8675e629-49db-44fd-b6a6-f689ef3cbc06 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:08.842115 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6ae76423-0fdf-4aca-ae65-38b530fcf866 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:08.842252 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8675e629-49db-44fd-b6a6-f689ef3cbc06 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:08.843356 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6ae76423-0fdf-4aca-ae65-38b530fcf866 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:08.844136 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6ae76423-0fdf-4aca-ae65-38b530fcf866 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:08.844913 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6ae76423-0fdf-4aca-ae65-38b530fcf866 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:09.234415 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8675e629-49db-44fd-b6a6-f689ef3cbc06 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:09.242106 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-8675e629-49db-44fd-b6a6-f689ef3cbc06 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1266 microversion: 2.1 time: 0.414478 Aug 05 20:10:09.242931 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 366/755] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:08 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1266 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:09.273096 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-6ae76423-0fdf-4aca-ae65-38b530fcf866 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:09.282091 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-6ae76423-0fdf-4aca-ae65-38b530fcf866 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1724 microversion: 2.1 time: 0.451723 Aug 05 20:10:09.282596 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 390/756] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:08 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1724 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:09.459845 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-03262138-de79-4b5b-9852-40e91d201e42 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:09.460478 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-03262138-de79-4b5b-9852-40e91d201e42 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:09.467591 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-03262138-de79-4b5b-9852-40e91d201e42 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:09.468072 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-03262138-de79-4b5b-9852-40e91d201e42 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:09.468524 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-03262138-de79-4b5b-9852-40e91d201e42 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:09.469234 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-03262138-de79-4b5b-9852-40e91d201e42 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:09.469685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-03262138-de79-4b5b-9852-40e91d201e42 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:09.470103 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-03262138-de79-4b5b-9852-40e91d201e42 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:09.707818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-03262138-de79-4b5b-9852-40e91d201e42 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:09.716325 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-03262138-de79-4b5b-9852-40e91d201e42 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:09.717971 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-03262138-de79-4b5b-9852-40e91d201e42 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:09.719131 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-03262138-de79-4b5b-9852-40e91d201e42 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1809 microversion: 2.20 time: 0.263177 Aug 05 20:10:09.719725 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 367/757] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:09 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1809 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:10.264116 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-60a8d3b6-71ed-4338-8bcc-fd9493be9a5e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:10.264897 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-60a8d3b6-71ed-4338-8bcc-fd9493be9a5e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:10.271653 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-60a8d3b6-71ed-4338-8bcc-fd9493be9a5e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:10.272147 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-60a8d3b6-71ed-4338-8bcc-fd9493be9a5e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:10.272613 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-60a8d3b6-71ed-4338-8bcc-fd9493be9a5e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:10.273928 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-60a8d3b6-71ed-4338-8bcc-fd9493be9a5e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:10.274680 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-60a8d3b6-71ed-4338-8bcc-fd9493be9a5e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:10.275218 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-60a8d3b6-71ed-4338-8bcc-fd9493be9a5e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:10.307551 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-397d04e5-ed6c-431f-9464-fdba266daed8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:10.308372 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-397d04e5-ed6c-431f-9464-fdba266daed8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:10.311150 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=84 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:10.316479 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-397d04e5-ed6c-431f-9464-fdba266daed8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:10.317102 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-397d04e5-ed6c-431f-9464-fdba266daed8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:10.317606 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-397d04e5-ed6c-431f-9464-fdba266daed8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:10.318317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-397d04e5-ed6c-431f-9464-fdba266daed8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:10.318774 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-397d04e5-ed6c-431f-9464-fdba266daed8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:10.319197 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-397d04e5-ed6c-431f-9464-fdba266daed8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:10.668397 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-60a8d3b6-71ed-4338-8bcc-fd9493be9a5e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:10.675745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-60a8d3b6-71ed-4338-8bcc-fd9493be9a5e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1266 microversion: 2.1 time: 0.415796 Aug 05 20:10:10.676311 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 391/758] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:10 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1266 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:10.687752 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-397d04e5-ed6c-431f-9464-fdba266daed8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:10.696099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-397d04e5-ed6c-431f-9464-fdba266daed8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1724 microversion: 2.1 time: 0.394349 Aug 05 20:10:10.696718 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 368/759] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:10 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1724 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:10.743547 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-d014cf62-e263-4c7f-872d-5a56f2f49e92 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:10.744153 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-d014cf62-e263-4c7f-872d-5a56f2f49e92 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:10.750004 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d014cf62-e263-4c7f-872d-5a56f2f49e92 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:10.750485 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d014cf62-e263-4c7f-872d-5a56f2f49e92 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:10.750919 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d014cf62-e263-4c7f-872d-5a56f2f49e92 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:10.751603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d014cf62-e263-4c7f-872d-5a56f2f49e92 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:10.752057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d014cf62-e263-4c7f-872d-5a56f2f49e92 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:10.752486 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d014cf62-e263-4c7f-872d-5a56f2f49e92 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:10.989090 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-d014cf62-e263-4c7f-872d-5a56f2f49e92 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:10.997816 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-d014cf62-e263-4c7f-872d-5a56f2f49e92 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:10.999562 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-d014cf62-e263-4c7f-872d-5a56f2f49e92 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:11.000729 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-d014cf62-e263-4c7f-872d-5a56f2f49e92 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1809 microversion: 2.20 time: 0.261635 Aug 05 20:10:11.001165 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 392/760] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:10 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1809 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:11.697917 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-bdc2c6f4-6c9e-4b70-9d26-6773cb96b5e7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:11.698521 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-bdc2c6f4-6c9e-4b70-9d26-6773cb96b5e7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:11.704930 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bdc2c6f4-6c9e-4b70-9d26-6773cb96b5e7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:11.705412 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bdc2c6f4-6c9e-4b70-9d26-6773cb96b5e7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:11.705842 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bdc2c6f4-6c9e-4b70-9d26-6773cb96b5e7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:11.706519 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bdc2c6f4-6c9e-4b70-9d26-6773cb96b5e7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:11.706964 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bdc2c6f4-6c9e-4b70-9d26-6773cb96b5e7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:11.707381 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bdc2c6f4-6c9e-4b70-9d26-6773cb96b5e7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:11.718201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-bd0b91c7-88dd-4ad4-bc14-f701032b93a1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:11.718816 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-bd0b91c7-88dd-4ad4-bc14-f701032b93a1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:11.725229 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-bd0b91c7-88dd-4ad4-bc14-f701032b93a1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:11.725721 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-bd0b91c7-88dd-4ad4-bc14-f701032b93a1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:11.726161 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-bd0b91c7-88dd-4ad4-bc14-f701032b93a1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:11.727726 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-bd0b91c7-88dd-4ad4-bc14-f701032b93a1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:11.728196 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-bd0b91c7-88dd-4ad4-bc14-f701032b93a1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:11.728654 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-bd0b91c7-88dd-4ad4-bc14-f701032b93a1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:11.923907 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-bdc2c6f4-6c9e-4b70-9d26-6773cb96b5e7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:11.927077 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-bd0b91c7-88dd-4ad4-bc14-f701032b93a1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:11.932373 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-bdc2c6f4-6c9e-4b70-9d26-6773cb96b5e7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1266 microversion: 2.1 time: 0.238464 Aug 05 20:10:11.933054 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 369/761] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:11 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:11.935966 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-bd0b91c7-88dd-4ad4-bc14-f701032b93a1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1724 microversion: 2.1 time: 0.221638 Aug 05 20:10:11.936528 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 393/762] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:11 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:12.025674 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-23e76ff1-02f9-4643-a973-7dab5315436a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:12.026283 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-23e76ff1-02f9-4643-a973-7dab5315436a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:12.032150 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-23e76ff1-02f9-4643-a973-7dab5315436a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:12.032665 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-23e76ff1-02f9-4643-a973-7dab5315436a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:12.033105 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-23e76ff1-02f9-4643-a973-7dab5315436a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:12.033792 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-23e76ff1-02f9-4643-a973-7dab5315436a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:12.034303 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-23e76ff1-02f9-4643-a973-7dab5315436a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:12.034669 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-23e76ff1-02f9-4643-a973-7dab5315436a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:12.412754 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-23e76ff1-02f9-4643-a973-7dab5315436a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:12.422427 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-23e76ff1-02f9-4643-a973-7dab5315436a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:12.423931 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-23e76ff1-02f9-4643-a973-7dab5315436a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:12.425125 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-23e76ff1-02f9-4643-a973-7dab5315436a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1796 microversion: 2.20 time: 0.403829 Aug 05 20:10:12.425686 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 370/763] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:10:12 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1796 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:10:12.953994 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-885e6bd7-00f0-465d-a9e4-d261d37e859e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:12.954606 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-885e6bd7-00f0-465d-a9e4-d261d37e859e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:12.957502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a0e7d22f-e1c1-43b7-940d-f829aecf85d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:12.958268 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-a0e7d22f-e1c1-43b7-940d-f829aecf85d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:12.961958 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-885e6bd7-00f0-465d-a9e4-d261d37e859e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:12.962672 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-885e6bd7-00f0-465d-a9e4-d261d37e859e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:12.962866 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-885e6bd7-00f0-465d-a9e4-d261d37e859e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:12.963566 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-885e6bd7-00f0-465d-a9e4-d261d37e859e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:12.964014 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-885e6bd7-00f0-465d-a9e4-d261d37e859e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:12.964435 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-885e6bd7-00f0-465d-a9e4-d261d37e859e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:12.965692 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a0e7d22f-e1c1-43b7-940d-f829aecf85d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:12.966181 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a0e7d22f-e1c1-43b7-940d-f829aecf85d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:12.966618 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a0e7d22f-e1c1-43b7-940d-f829aecf85d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:12.967311 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a0e7d22f-e1c1-43b7-940d-f829aecf85d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:12.967786 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a0e7d22f-e1c1-43b7-940d-f829aecf85d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:12.968208 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a0e7d22f-e1c1-43b7-940d-f829aecf85d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:12.968703 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:13.168601 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a0e7d22f-e1c1-43b7-940d-f829aecf85d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:13.173619 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-885e6bd7-00f0-465d-a9e4-d261d37e859e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:13.176654 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-a0e7d22f-e1c1-43b7-940d-f829aecf85d3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1724 microversion: 2.1 time: 0.222878 Aug 05 20:10:13.177240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 371/764] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:12 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:13.181941 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-885e6bd7-00f0-465d-a9e4-d261d37e859e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1266 microversion: 2.1 time: 0.231904 Aug 05 20:10:13.182556 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 394/765] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:12 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:14.198031 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3f9a53f7-6a1b-40a7-8977-88cd4dfcde18 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:14.198648 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-3f9a53f7-6a1b-40a7-8977-88cd4dfcde18 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:14.202420 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-992a61ab-ba83-4470-bca5-519ca9ba6319 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:14.203054 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-992a61ab-ba83-4470-bca5-519ca9ba6319 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:14.204788 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3f9a53f7-6a1b-40a7-8977-88cd4dfcde18 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:14.205277 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3f9a53f7-6a1b-40a7-8977-88cd4dfcde18 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:14.205709 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3f9a53f7-6a1b-40a7-8977-88cd4dfcde18 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:14.206424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3f9a53f7-6a1b-40a7-8977-88cd4dfcde18 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:14.206872 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3f9a53f7-6a1b-40a7-8977-88cd4dfcde18 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:14.207295 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3f9a53f7-6a1b-40a7-8977-88cd4dfcde18 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:14.209430 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-992a61ab-ba83-4470-bca5-519ca9ba6319 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:14.209911 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-992a61ab-ba83-4470-bca5-519ca9ba6319 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:14.210367 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-992a61ab-ba83-4470-bca5-519ca9ba6319 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:14.211597 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-992a61ab-ba83-4470-bca5-519ca9ba6319 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:14.212048 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-992a61ab-ba83-4470-bca5-519ca9ba6319 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:14.212472 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-992a61ab-ba83-4470-bca5-519ca9ba6319 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:14.222942 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=100 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:14.409241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3f9a53f7-6a1b-40a7-8977-88cd4dfcde18 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:14.413692 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-992a61ab-ba83-4470-bca5-519ca9ba6319 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:14.418093 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3f9a53f7-6a1b-40a7-8977-88cd4dfcde18 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1724 microversion: 2.1 time: 0.224158 Aug 05 20:10:14.418684 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 372/766] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:14 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:14.421807 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-992a61ab-ba83-4470-bca5-519ca9ba6319 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1266 microversion: 2.1 time: 0.223374 Aug 05 20:10:14.422367 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 395/767] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:14 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:15.439531 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-723de302-deb3-47db-ac14-49f3901cd2fd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:15.440103 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-723de302-deb3-47db-ac14-49f3901cd2fd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:15.442275 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4caaac29-d09c-49d3-a716-eef4e1dc0b81 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:15.442949 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-4caaac29-d09c-49d3-a716-eef4e1dc0b81 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:15.447458 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-723de302-deb3-47db-ac14-49f3901cd2fd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:15.447954 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-723de302-deb3-47db-ac14-49f3901cd2fd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:15.448392 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-723de302-deb3-47db-ac14-49f3901cd2fd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:15.449168 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-723de302-deb3-47db-ac14-49f3901cd2fd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:15.449630 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-723de302-deb3-47db-ac14-49f3901cd2fd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:15.449972 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4caaac29-d09c-49d3-a716-eef4e1dc0b81 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:15.450083 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-723de302-deb3-47db-ac14-49f3901cd2fd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:15.450472 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4caaac29-d09c-49d3-a716-eef4e1dc0b81 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:15.450943 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4caaac29-d09c-49d3-a716-eef4e1dc0b81 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:15.451651 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4caaac29-d09c-49d3-a716-eef4e1dc0b81 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:15.452105 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4caaac29-d09c-49d3-a716-eef4e1dc0b81 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:15.452531 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4caaac29-d09c-49d3-a716-eef4e1dc0b81 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:15.652180 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-723de302-deb3-47db-ac14-49f3901cd2fd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:15.655884 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-4caaac29-d09c-49d3-a716-eef4e1dc0b81 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:15.660708 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-723de302-deb3-47db-ac14-49f3901cd2fd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1724 microversion: 2.1 time: 0.225120 Aug 05 20:10:15.661286 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 373/768] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:15 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:15.663441 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-4caaac29-d09c-49d3-a716-eef4e1dc0b81 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1266 microversion: 2.1 time: 0.225116 Aug 05 20:10:15.664062 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 396/769] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:15 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:16.684294 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-252de5c7-056c-4ab8-945f-ec7edf225ed5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:16.684937 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-252de5c7-056c-4ab8-945f-ec7edf225ed5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:16.685046 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-7bb05745-ddf4-4a38-a1b1-630713ad5f7a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:16.685595 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-7bb05745-ddf4-4a38-a1b1-630713ad5f7a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:16.691824 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-252de5c7-056c-4ab8-945f-ec7edf225ed5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:16.692174 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7bb05745-ddf4-4a38-a1b1-630713ad5f7a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:16.692349 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-252de5c7-056c-4ab8-945f-ec7edf225ed5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:16.692691 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7bb05745-ddf4-4a38-a1b1-630713ad5f7a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:16.692806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-252de5c7-056c-4ab8-945f-ec7edf225ed5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:16.693126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7bb05745-ddf4-4a38-a1b1-630713ad5f7a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:16.693522 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-252de5c7-056c-4ab8-945f-ec7edf225ed5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:16.693819 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7bb05745-ddf4-4a38-a1b1-630713ad5f7a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:16.693995 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-252de5c7-056c-4ab8-945f-ec7edf225ed5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:16.694269 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7bb05745-ddf4-4a38-a1b1-630713ad5f7a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:16.694422 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-252de5c7-056c-4ab8-945f-ec7edf225ed5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:16.694749 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7bb05745-ddf4-4a38-a1b1-630713ad5f7a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:16.901620 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-7bb05745-ddf4-4a38-a1b1-630713ad5f7a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:16.905898 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-252de5c7-056c-4ab8-945f-ec7edf225ed5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:16.910444 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-7bb05745-ddf4-4a38-a1b1-630713ad5f7a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1266 microversion: 2.1 time: 0.229642 Aug 05 20:10:16.911033 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 397/770] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:16 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:16.914805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-252de5c7-056c-4ab8-945f-ec7edf225ed5 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1730 microversion: 2.1 time: 0.235225 Aug 05 20:10:16.915386 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 374/771] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:16 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1730 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:16.937427 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-f1f13b3b-38b8-42db-9500-2d9a0308033a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:16.937937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-f1f13b3b-38b8-42db-9500-2d9a0308033a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:16.944037 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f1f13b3b-38b8-42db-9500-2d9a0308033a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:16.944537 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f1f13b3b-38b8-42db-9500-2d9a0308033a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:16.945616 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f1f13b3b-38b8-42db-9500-2d9a0308033a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:16.946224 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f1f13b3b-38b8-42db-9500-2d9a0308033a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:16.946687 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f1f13b3b-38b8-42db-9500-2d9a0308033a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:16.947118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f1f13b3b-38b8-42db-9500-2d9a0308033a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:17.034144 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-f1f13b3b-38b8-42db-9500-2d9a0308033a tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100647 Aug 05 20:10:17.034738 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 398/772] 10.222.0.39 () {58 vars in 1275 bytes} [Fri Aug 5 20:10:16 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:10:17.942231 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-653428c4-4203-4afb-9e1a-bded55b748ad tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:17.942850 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-653428c4-4203-4afb-9e1a-bded55b748ad tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:17.949761 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-653428c4-4203-4afb-9e1a-bded55b748ad tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:17.950574 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-653428c4-4203-4afb-9e1a-bded55b748ad tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:17.951217 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-653428c4-4203-4afb-9e1a-bded55b748ad tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:17.952309 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-653428c4-4203-4afb-9e1a-bded55b748ad tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:17.953562 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-653428c4-4203-4afb-9e1a-bded55b748ad tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:17.954183 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-653428c4-4203-4afb-9e1a-bded55b748ad tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:17.992611 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-ddc7ca77-c946-4f5f-a3f2-ab119b1ad560 req-d5f83a36-3d57-4049-9b62-b0569224c0ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1", "tag": "780a6046-5a34-4fe1-b8f7-b847e0fc78b0"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:18.004294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-ddc7ca77-c946-4f5f-a3f2-ab119b1ad560 req-d5f83a36-3d57-4049-9b62-b0569224c0ea service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:18.005692 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-ddc7ca77-c946-4f5f-a3f2-ab119b1ad560 req-d5f83a36-3d57-4049-9b62-b0569224c0ea service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:18.006265 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-ddc7ca77-c946-4f5f-a3f2-ab119b1ad560 req-d5f83a36-3d57-4049-9b62-b0569224c0ea service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:18.021700 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-ddc7ca77-c946-4f5f-a3f2-ab119b1ad560 req-d5f83a36-3d57-4049-9b62-b0569224c0ea service nova] Creating event network-changed:780a6046-5a34-4fe1-b8f7-b847e0fc78b0 for instance 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 on hv-cinder-85221 Aug 05 20:10:18.030620 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-ddc7ca77-c946-4f5f-a3f2-ab119b1ad560 req-d5f83a36-3d57-4049-9b62-b0569224c0ea service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042563 Aug 05 20:10:18.031527 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 399/773] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:10:18.130165 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-653428c4-4203-4afb-9e1a-bded55b748ad tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:18.142066 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-653428c4-4203-4afb-9e1a-bded55b748ad tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1266 microversion: 2.1 time: 0.204387 Aug 05 20:10:18.143285 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 375/774] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:17 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:19.165094 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4b4acb0f-e988-483a-b234-080ba1879257 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:19.165816 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-4b4acb0f-e988-483a-b234-080ba1879257 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:19.172120 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4b4acb0f-e988-483a-b234-080ba1879257 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:19.172639 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4b4acb0f-e988-483a-b234-080ba1879257 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:19.173084 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4b4acb0f-e988-483a-b234-080ba1879257 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:19.173789 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4b4acb0f-e988-483a-b234-080ba1879257 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:19.174252 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4b4acb0f-e988-483a-b234-080ba1879257 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:19.174701 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4b4acb0f-e988-483a-b234-080ba1879257 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:19.316797 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-4b4acb0f-e988-483a-b234-080ba1879257 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:19.324759 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-4b4acb0f-e988-483a-b234-080ba1879257 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1266 microversion: 2.1 time: 0.164901 Aug 05 20:10:19.325253 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 400/775] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:19 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:19.822226 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-d703a11e-dd5c-403f-9920-ff8665177d1c req-4d29430d-bb7c-4b99-af8c-0cea13a665f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "412b5860-2133-41f8-8960-b3f068a8f11f", "name": "network-vif-plugged", "status": "completed", "tag": "0a61f0d0-34bf-488d-a986-3ba8db0d4db6"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:19.834233 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-d703a11e-dd5c-403f-9920-ff8665177d1c req-4d29430d-bb7c-4b99-af8c-0cea13a665f1 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:19.834810 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-d703a11e-dd5c-403f-9920-ff8665177d1c req-4d29430d-bb7c-4b99-af8c-0cea13a665f1 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:19.835883 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-d703a11e-dd5c-403f-9920-ff8665177d1c req-4d29430d-bb7c-4b99-af8c-0cea13a665f1 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:19.849694 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-d703a11e-dd5c-403f-9920-ff8665177d1c req-4d29430d-bb7c-4b99-af8c-0cea13a665f1 service nova] Creating event network-vif-plugged:0a61f0d0-34bf-488d-a986-3ba8db0d4db6 for instance 412b5860-2133-41f8-8960-b3f068a8f11f on hv-cinder-85221 Aug 05 20:10:19.855235 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-d703a11e-dd5c-403f-9920-ff8665177d1c req-4d29430d-bb7c-4b99-af8c-0cea13a665f1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038374 Aug 05 20:10:19.855862 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 376/776] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:10:20.053392 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-1a2c84ec-8fce-46fc-91fb-c98fb1378d70 req-2ddc4e42-de73-4e57-9df1-e41e60856588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1", "tag": "780a6046-5a34-4fe1-b8f7-b847e0fc78b0"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:20.064944 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-1a2c84ec-8fce-46fc-91fb-c98fb1378d70 req-2ddc4e42-de73-4e57-9df1-e41e60856588 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:20.065536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-1a2c84ec-8fce-46fc-91fb-c98fb1378d70 req-2ddc4e42-de73-4e57-9df1-e41e60856588 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:20.065969 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-1a2c84ec-8fce-46fc-91fb-c98fb1378d70 req-2ddc4e42-de73-4e57-9df1-e41e60856588 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:20.078588 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-1a2c84ec-8fce-46fc-91fb-c98fb1378d70 req-2ddc4e42-de73-4e57-9df1-e41e60856588 service nova] Creating event network-changed:780a6046-5a34-4fe1-b8f7-b847e0fc78b0 for instance 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 on hv-cinder-85221 Aug 05 20:10:20.083836 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-1a2c84ec-8fce-46fc-91fb-c98fb1378d70 req-2ddc4e42-de73-4e57-9df1-e41e60856588 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034493 Aug 05 20:10:20.084561 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 401/777] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:10:20.346706 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-74b2de7d-8072-4c3b-8be8-fc38fb2e6206 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:20.347572 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-74b2de7d-8072-4c3b-8be8-fc38fb2e6206 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:20.354115 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-74b2de7d-8072-4c3b-8be8-fc38fb2e6206 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:20.355939 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-74b2de7d-8072-4c3b-8be8-fc38fb2e6206 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:20.355939 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-74b2de7d-8072-4c3b-8be8-fc38fb2e6206 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:20.355939 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-74b2de7d-8072-4c3b-8be8-fc38fb2e6206 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:20.355939 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-74b2de7d-8072-4c3b-8be8-fc38fb2e6206 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:20.359052 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-74b2de7d-8072-4c3b-8be8-fc38fb2e6206 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:20.505466 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-74b2de7d-8072-4c3b-8be8-fc38fb2e6206 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:20.513592 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-74b2de7d-8072-4c3b-8be8-fc38fb2e6206 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1266 microversion: 2.1 time: 0.171150 Aug 05 20:10:20.514182 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 377/778] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:20 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:21.534185 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-9159cbb8-f360-4d21-87e7-1ad9a65653dd tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:21.534792 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-9159cbb8-f360-4d21-87e7-1ad9a65653dd tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:21.542217 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9159cbb8-f360-4d21-87e7-1ad9a65653dd tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:21.542700 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9159cbb8-f360-4d21-87e7-1ad9a65653dd tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:21.543132 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9159cbb8-f360-4d21-87e7-1ad9a65653dd tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:21.543827 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9159cbb8-f360-4d21-87e7-1ad9a65653dd tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:21.544390 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9159cbb8-f360-4d21-87e7-1ad9a65653dd tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:21.544845 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9159cbb8-f360-4d21-87e7-1ad9a65653dd tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:21.750241 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-9159cbb8-f360-4d21-87e7-1ad9a65653dd tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:21.758859 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-9159cbb8-f360-4d21-87e7-1ad9a65653dd tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1266 microversion: 2.1 time: 0.228844 Aug 05 20:10:21.759446 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 402/779] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:21 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:22.779777 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f5dc4bef-142c-414d-909e-c71f8c5e98c0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:22.780385 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f5dc4bef-142c-414d-909e-c71f8c5e98c0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:22.786808 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f5dc4bef-142c-414d-909e-c71f8c5e98c0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:22.787285 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f5dc4bef-142c-414d-909e-c71f8c5e98c0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:22.787713 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f5dc4bef-142c-414d-909e-c71f8c5e98c0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:22.788467 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f5dc4bef-142c-414d-909e-c71f8c5e98c0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:22.788938 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f5dc4bef-142c-414d-909e-c71f8c5e98c0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:22.789356 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f5dc4bef-142c-414d-909e-c71f8c5e98c0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:22.924542 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f5dc4bef-142c-414d-909e-c71f8c5e98c0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:22.932172 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f5dc4bef-142c-414d-909e-c71f8c5e98c0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1453 microversion: 2.1 time: 0.156240 Aug 05 20:10:22.932762 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 378/780] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:22 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:22.952539 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-de22b619-cc48-44cb-bd5c-e599910047f2 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:22.953234 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-de22b619-cc48-44cb-bd5c-e599910047f2 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:22.959625 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de22b619-cc48-44cb-bd5c-e599910047f2 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:22.960792 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de22b619-cc48-44cb-bd5c-e599910047f2 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:22.961194 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de22b619-cc48-44cb-bd5c-e599910047f2 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:22.961905 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de22b619-cc48-44cb-bd5c-e599910047f2 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:22.962640 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de22b619-cc48-44cb-bd5c-e599910047f2 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:22.962850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de22b619-cc48-44cb-bd5c-e599910047f2 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:23.095212 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-de22b619-cc48-44cb-bd5c-e599910047f2 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:23.103160 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-de22b619-cc48-44cb-bd5c-e599910047f2 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1453 microversion: 2.1 time: 0.154511 Aug 05 20:10:23.103733 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 403/781] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:22 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:24.984510 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-79e70ef4-a4aa-41ad-8cfb-02db6e801104 req-d086233a-d6e4-4771-a957-c3689520ea4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "412b5860-2133-41f8-8960-b3f068a8f11f", "tag": "0a61f0d0-34bf-488d-a986-3ba8db0d4db6"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:24.994720 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-79e70ef4-a4aa-41ad-8cfb-02db6e801104 req-d086233a-d6e4-4771-a957-c3689520ea4d service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:24.995224 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-79e70ef4-a4aa-41ad-8cfb-02db6e801104 req-d086233a-d6e4-4771-a957-c3689520ea4d service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:24.995933 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-79e70ef4-a4aa-41ad-8cfb-02db6e801104 req-d086233a-d6e4-4771-a957-c3689520ea4d service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:25.166226 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-79e70ef4-a4aa-41ad-8cfb-02db6e801104 req-d086233a-d6e4-4771-a957-c3689520ea4d service nova] Creating event network-changed:0a61f0d0-34bf-488d-a986-3ba8db0d4db6 for instance 412b5860-2133-41f8-8960-b3f068a8f11f on hv-cinder-85221 Aug 05 20:10:25.171584 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-79e70ef4-a4aa-41ad-8cfb-02db6e801104 req-d086233a-d6e4-4771-a957-c3689520ea4d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191043 Aug 05 20:10:25.172124 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 379/782] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:10:25.783112 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-cd97aa5e-e4b0-4024-9e79-3c08258f4be6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:25.785635 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-cd97aa5e-e4b0-4024-9e79-3c08258f4be6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:25.793273 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cd97aa5e-e4b0-4024-9e79-3c08258f4be6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:25.793762 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cd97aa5e-e4b0-4024-9e79-3c08258f4be6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:25.794192 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cd97aa5e-e4b0-4024-9e79-3c08258f4be6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:25.794897 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cd97aa5e-e4b0-4024-9e79-3c08258f4be6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:25.795383 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cd97aa5e-e4b0-4024-9e79-3c08258f4be6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:25.795802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cd97aa5e-e4b0-4024-9e79-3c08258f4be6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:25.886287 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-cd97aa5e-e4b0-4024-9e79-3c08258f4be6 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "POST /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760/action" status: 202 len: 0 microversion: 2.1 time: 0.106990 Aug 05 20:10:25.891343 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 404/783] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Aug 5 20:10:25 2022] POST /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:10:25.902496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9f083ef3-2bbd-4b7a-898a-d5d21a965433 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:25.903210 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-9f083ef3-2bbd-4b7a-898a-d5d21a965433 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:25.921218 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9f083ef3-2bbd-4b7a-898a-d5d21a965433 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:25.921714 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9f083ef3-2bbd-4b7a-898a-d5d21a965433 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:25.922456 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9f083ef3-2bbd-4b7a-898a-d5d21a965433 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:25.923185 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9f083ef3-2bbd-4b7a-898a-d5d21a965433 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:25.923887 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9f083ef3-2bbd-4b7a-898a-d5d21a965433 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:25.924328 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9f083ef3-2bbd-4b7a-898a-d5d21a965433 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:26.285310 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9f083ef3-2bbd-4b7a-898a-d5d21a965433 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:26.293555 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-9f083ef3-2bbd-4b7a-898a-d5d21a965433 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1752 microversion: 2.1 time: 0.401030 Aug 05 20:10:26.294930 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 380/784] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:25 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1752 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:27.317606 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-9e2e1c34-49c1-4f8c-92ad-6de774cda318 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:27.318256 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-9e2e1c34-49c1-4f8c-92ad-6de774cda318 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:27.324335 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9e2e1c34-49c1-4f8c-92ad-6de774cda318 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:27.324837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9e2e1c34-49c1-4f8c-92ad-6de774cda318 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:27.325267 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9e2e1c34-49c1-4f8c-92ad-6de774cda318 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:27.325952 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9e2e1c34-49c1-4f8c-92ad-6de774cda318 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:27.326402 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9e2e1c34-49c1-4f8c-92ad-6de774cda318 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:27.326823 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9e2e1c34-49c1-4f8c-92ad-6de774cda318 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:27.471845 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-9e2e1c34-49c1-4f8c-92ad-6de774cda318 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:27.480976 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-9e2e1c34-49c1-4f8c-92ad-6de774cda318 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1757 microversion: 2.1 time: 0.168198 Aug 05 20:10:27.481550 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 405/785] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:27 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:28.504196 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3e084666-accf-48fc-b7c9-87176d0e1e12 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:28.504860 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-3e084666-accf-48fc-b7c9-87176d0e1e12 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:28.512814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e084666-accf-48fc-b7c9-87176d0e1e12 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:28.513312 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e084666-accf-48fc-b7c9-87176d0e1e12 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:28.513754 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e084666-accf-48fc-b7c9-87176d0e1e12 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:28.514496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e084666-accf-48fc-b7c9-87176d0e1e12 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:28.514955 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e084666-accf-48fc-b7c9-87176d0e1e12 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:28.515384 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e084666-accf-48fc-b7c9-87176d0e1e12 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:28.662007 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3e084666-accf-48fc-b7c9-87176d0e1e12 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:28.671209 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3e084666-accf-48fc-b7c9-87176d0e1e12 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1757 microversion: 2.1 time: 0.171640 Aug 05 20:10:28.671806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 381/786] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:28 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:29.705696 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-6337e4af-32fb-4b82-a22f-78bc96a70c55 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:29.706340 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-6337e4af-32fb-4b82-a22f-78bc96a70c55 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:29.713135 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6337e4af-32fb-4b82-a22f-78bc96a70c55 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:29.713623 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6337e4af-32fb-4b82-a22f-78bc96a70c55 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:29.714058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6337e4af-32fb-4b82-a22f-78bc96a70c55 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:29.714789 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6337e4af-32fb-4b82-a22f-78bc96a70c55 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:29.715248 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6337e4af-32fb-4b82-a22f-78bc96a70c55 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:29.715751 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6337e4af-32fb-4b82-a22f-78bc96a70c55 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:29.869501 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-6337e4af-32fb-4b82-a22f-78bc96a70c55 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:29.877577 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-6337e4af-32fb-4b82-a22f-78bc96a70c55 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1757 microversion: 2.1 time: 0.175925 Aug 05 20:10:29.878155 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 406/787] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:29 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:30.899935 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-c5c07a2f-7677-4774-92c2-7505114809a0 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:30.900527 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-c5c07a2f-7677-4774-92c2-7505114809a0 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:30.907566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c5c07a2f-7677-4774-92c2-7505114809a0 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:30.908055 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c5c07a2f-7677-4774-92c2-7505114809a0 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:30.908484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c5c07a2f-7677-4774-92c2-7505114809a0 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:30.909206 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c5c07a2f-7677-4774-92c2-7505114809a0 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:30.909657 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c5c07a2f-7677-4774-92c2-7505114809a0 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:30.910078 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c5c07a2f-7677-4774-92c2-7505114809a0 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:31.062794 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-c5c07a2f-7677-4774-92c2-7505114809a0 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:31.072246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-c5c07a2f-7677-4774-92c2-7505114809a0 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1757 microversion: 2.1 time: 0.176705 Aug 05 20:10:31.072852 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 382/788] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:30 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:32.092466 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-1e735c93-26f1-4e36-8ab9-2e9df61e383e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:32.093104 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-1e735c93-26f1-4e36-8ab9-2e9df61e383e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:32.099434 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1e735c93-26f1-4e36-8ab9-2e9df61e383e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:32.099919 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1e735c93-26f1-4e36-8ab9-2e9df61e383e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:32.100353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1e735c93-26f1-4e36-8ab9-2e9df61e383e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:32.101800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1e735c93-26f1-4e36-8ab9-2e9df61e383e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:32.102292 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1e735c93-26f1-4e36-8ab9-2e9df61e383e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:32.102805 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1e735c93-26f1-4e36-8ab9-2e9df61e383e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:32.259483 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-1e735c93-26f1-4e36-8ab9-2e9df61e383e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:32.267680 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-1e735c93-26f1-4e36-8ab9-2e9df61e383e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1757 microversion: 2.1 time: 0.179115 Aug 05 20:10:32.268240 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 407/789] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:32 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:33.290232 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-66bf9f89-f83a-4be0-9a81-e9b41db4c3dc tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:33.290846 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-66bf9f89-f83a-4be0-9a81-e9b41db4c3dc tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:33.297645 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-66bf9f89-f83a-4be0-9a81-e9b41db4c3dc tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:33.298146 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-66bf9f89-f83a-4be0-9a81-e9b41db4c3dc tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:33.298589 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-66bf9f89-f83a-4be0-9a81-e9b41db4c3dc tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:33.299333 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-66bf9f89-f83a-4be0-9a81-e9b41db4c3dc tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:33.299842 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-66bf9f89-f83a-4be0-9a81-e9b41db4c3dc tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:33.300561 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-66bf9f89-f83a-4be0-9a81-e9b41db4c3dc tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:33.451039 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-66bf9f89-f83a-4be0-9a81-e9b41db4c3dc tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:33.459013 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-66bf9f89-f83a-4be0-9a81-e9b41db4c3dc tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1757 microversion: 2.1 time: 0.172847 Aug 05 20:10:33.459574 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 383/790] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:33 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:34.480166 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-92e02d4c-4961-4af0-9003-375d06e96748 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:34.480726 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-92e02d4c-4961-4af0-9003-375d06e96748 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:34.483090 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=54 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:34.488424 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-92e02d4c-4961-4af0-9003-375d06e96748 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:34.488935 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-92e02d4c-4961-4af0-9003-375d06e96748 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:34.489372 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-92e02d4c-4961-4af0-9003-375d06e96748 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:34.490065 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-92e02d4c-4961-4af0-9003-375d06e96748 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:34.490515 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-92e02d4c-4961-4af0-9003-375d06e96748 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:34.490939 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-92e02d4c-4961-4af0-9003-375d06e96748 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:34.637553 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-92e02d4c-4961-4af0-9003-375d06e96748 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:34.645803 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-92e02d4c-4961-4af0-9003-375d06e96748 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1757 microversion: 2.1 time: 0.169866 Aug 05 20:10:34.646372 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 408/791] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:34 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:35.668986 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e911536f-f482-4b45-850c-aee098c9d227 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:35.669636 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e911536f-f482-4b45-850c-aee098c9d227 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:35.676988 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e911536f-f482-4b45-850c-aee098c9d227 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:35.677484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e911536f-f482-4b45-850c-aee098c9d227 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:35.678082 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e911536f-f482-4b45-850c-aee098c9d227 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:35.679470 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e911536f-f482-4b45-850c-aee098c9d227 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:35.680052 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e911536f-f482-4b45-850c-aee098c9d227 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:35.680551 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e911536f-f482-4b45-850c-aee098c9d227 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:35.835813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e911536f-f482-4b45-850c-aee098c9d227 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:35.843859 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e911536f-f482-4b45-850c-aee098c9d227 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1757 microversion: 2.1 time: 0.178991 Aug 05 20:10:35.844446 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 384/792] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:35 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:36.865560 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-23d8c561-05af-4407-8575-e0f719ef6523 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:36.866199 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-23d8c561-05af-4407-8575-e0f719ef6523 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:36.873422 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-23d8c561-05af-4407-8575-e0f719ef6523 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:36.873904 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-23d8c561-05af-4407-8575-e0f719ef6523 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:36.874337 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-23d8c561-05af-4407-8575-e0f719ef6523 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:36.875015 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-23d8c561-05af-4407-8575-e0f719ef6523 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:36.875495 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-23d8c561-05af-4407-8575-e0f719ef6523 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:36.875913 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-23d8c561-05af-4407-8575-e0f719ef6523 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:37.019542 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-23d8c561-05af-4407-8575-e0f719ef6523 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:37.028104 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-23d8c561-05af-4407-8575-e0f719ef6523 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1757 microversion: 2.1 time: 0.166357 Aug 05 20:10:37.028680 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 409/793] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:36 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:38.049685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3627cea8-0377-4dbf-a4d1-cfa1f2bb078d tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:38.050338 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-3627cea8-0377-4dbf-a4d1-cfa1f2bb078d tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:38.057546 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3627cea8-0377-4dbf-a4d1-cfa1f2bb078d tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:38.058041 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3627cea8-0377-4dbf-a4d1-cfa1f2bb078d tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:38.058479 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3627cea8-0377-4dbf-a4d1-cfa1f2bb078d tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:38.059184 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3627cea8-0377-4dbf-a4d1-cfa1f2bb078d tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:38.059642 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3627cea8-0377-4dbf-a4d1-cfa1f2bb078d tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:38.060077 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3627cea8-0377-4dbf-a4d1-cfa1f2bb078d tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:38.206992 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3627cea8-0377-4dbf-a4d1-cfa1f2bb078d tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:38.227588 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3627cea8-0377-4dbf-a4d1-cfa1f2bb078d tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1757 microversion: 2.1 time: 0.181682 Aug 05 20:10:38.228096 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 385/794] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:38 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:39.248887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-12ae2714-697c-4daa-84b4-893d1cdd2151 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:39.249494 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-12ae2714-697c-4daa-84b4-893d1cdd2151 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:39.255977 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-12ae2714-697c-4daa-84b4-893d1cdd2151 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:39.256454 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-12ae2714-697c-4daa-84b4-893d1cdd2151 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:39.257536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-12ae2714-697c-4daa-84b4-893d1cdd2151 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:39.258276 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-12ae2714-697c-4daa-84b4-893d1cdd2151 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:39.258693 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-12ae2714-697c-4daa-84b4-893d1cdd2151 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:39.259113 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-12ae2714-697c-4daa-84b4-893d1cdd2151 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:39.403973 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-12ae2714-697c-4daa-84b4-893d1cdd2151 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:39.412002 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-12ae2714-697c-4daa-84b4-893d1cdd2151 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1757 microversion: 2.1 time: 0.166992 Aug 05 20:10:39.412557 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 410/795] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:39 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:40.436484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-b01cd8a1-f1ea-45b7-96d5-90b046110e9f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:40.437060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-b01cd8a1-f1ea-45b7-96d5-90b046110e9f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:40.439487 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=36 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:40.444954 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b01cd8a1-f1ea-45b7-96d5-90b046110e9f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:40.445437 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b01cd8a1-f1ea-45b7-96d5-90b046110e9f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:40.445905 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b01cd8a1-f1ea-45b7-96d5-90b046110e9f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:40.446600 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b01cd8a1-f1ea-45b7-96d5-90b046110e9f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:40.447045 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b01cd8a1-f1ea-45b7-96d5-90b046110e9f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:40.447464 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b01cd8a1-f1ea-45b7-96d5-90b046110e9f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:40.594263 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-b01cd8a1-f1ea-45b7-96d5-90b046110e9f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:40.603110 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-b01cd8a1-f1ea-45b7-96d5-90b046110e9f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1757 microversion: 2.1 time: 0.169676 Aug 05 20:10:40.603809 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 386/796] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:40 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:41.287126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-19e5565b-ec73-41ea-b589-8b88972a54e7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:41.287653 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-19e5565b-ec73-41ea-b589-8b88972a54e7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:41.294665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-19e5565b-ec73-41ea-b589-8b88972a54e7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:41.295188 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-19e5565b-ec73-41ea-b589-8b88972a54e7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:41.295629 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-19e5565b-ec73-41ea-b589-8b88972a54e7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:41.296328 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-19e5565b-ec73-41ea-b589-8b88972a54e7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:41.296820 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-19e5565b-ec73-41ea-b589-8b88972a54e7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:41.297254 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-19e5565b-ec73-41ea-b589-8b88972a54e7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:41.311261 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:41.322316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-19e5565b-ec73-41ea-b589-8b88972a54e7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263/ips" status: 200 len: 150 microversion: 2.1 time: 0.039084 Aug 05 20:10:41.322885 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 411/797] 10.222.0.39 () {58 vars in 1248 bytes} [Fri Aug 5 20:10:41 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:10:41.334311 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-cbbf97e5-4785-463b-8208-2fdca0083524 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "700ac612-fd67-4a2c-8a70-a7db07eb5a4a"}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:41.336645 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-cbbf97e5-4785-463b-8208-2fdca0083524 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:41.342593 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cbbf97e5-4785-463b-8208-2fdca0083524 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:41.343075 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cbbf97e5-4785-463b-8208-2fdca0083524 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:41.343509 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cbbf97e5-4785-463b-8208-2fdca0083524 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:41.344194 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cbbf97e5-4785-463b-8208-2fdca0083524 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:41.344785 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cbbf97e5-4785-463b-8208-2fdca0083524 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:41.345212 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cbbf97e5-4785-463b-8208-2fdca0083524 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:41.427506 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-cbbf97e5-4785-463b-8208-2fdca0083524 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] HTTP exception thrown: Invalid volume: volume 700ac612-fd67-4a2c-8a70-a7db07eb5a4a is already attached to instances: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 Aug 05 20:10:41.429241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-cbbf97e5-4785-463b-8208-2fdca0083524 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Request method failure captured: Aug 05 20:10:41.429241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: POST /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263/os-volume_attachments HTTP/1.1 Aug 05 20:10:41.429241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:10:41.429241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:10:41.429241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:10:41.429241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 74 Aug 05 20:10:41.429241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:10:41.429241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:10:41.429241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:10:41.429241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:10:41.429241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XdntYBLdlzvV7cyFg7UZC73a9OJV17dQagpc389c8g9F6eau2Yker8zNfrWRXvHE1X0s0ayqdbHqjuJX7Cxd2dg4OAmYf40eOt9KRb9kWilSf-b7MsgEH66CO1Uwzjbe3hC1fmQKpJ9W4mMdw5ek_dNUUbduEc7m-XkxS7A18A4T74 Aug 05 20:10:41.429241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:10:41.429241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:10:41.429241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:10:41.429241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:10:41.429241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:10:41.429241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:10:41.429241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:10:41.429241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:10:41.429241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:10:41.429241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:10:41.431381 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5b265913f9bd46b9b36c18d567d0cf66", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:10:41.431381 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:10:41.431381 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:10:41.431381 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:10:41.431381 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:10:41.431381 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:10:41.431381 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:10:41.431381 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: 1afe13c8fbb1468b8ef3d0d0c671208d Aug 05 20:10:41.431381 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:10:41.431381 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Aug 05 20:10:41.431381 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {"volumeAttachment": {"volumeId": "700ac612-fd67-4a2c-8a70-a7db07eb5a4a"}} Aug 05 20:10:41.431381 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: > Aug 05 20:10:41.432196 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Invalid volume: volume 700ac612-fd67-4a2c-8a70-a7db07eb5a4a is already attached to instances: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 Aug 05 20:10:41.432196 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'server_id': '2c68719b-222e-48b2-9ce7-55ed27758263', 'body': {'volumeAttachment': {'volumeId': '700ac612-fd67-4a2c-8a70-a7db07eb5a4a'}}} Aug 05 20:10:41.432196 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:10:41.432196 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:10:41.432196 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 20:10:41.432196 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 20:10:41.432196 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 20:10:41.432196 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 20:10:41.432196 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 05 20:10:41.432196 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 05 20:10:41.432196 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 05 20:10:41.432196 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 05 20:10:41.432196 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 05 20:10:41.432196 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 05 20:10:41.432196 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 700ac612-fd67-4a2c-8a70-a7db07eb5a4a is already attached to instances: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 Aug 05 20:10:41.432196 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:10:41.432196 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:10:41.432196 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:10:41.432196 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:10:41.433869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:10:41.433869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:10:41.433869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:10:41.433869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:10:41.433869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:10:41.433869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:10:41.433869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:10:41.433869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:10:41.433869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:10:41.433869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:10:41.433869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:10:41.433869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:10:41.433869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 05 20:10:41.433869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 05 20:10:41.433869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 700ac612-fd67-4a2c-8a70-a7db07eb5a4a is already attached to instances: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 Aug 05 20:10:41.433869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:10:41.433869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:10:41.433869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:10:41.433869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:10:41.433869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:10:41.435709 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:10:41.435709 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:10:41.435709 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:10:41.435709 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 700ac612-fd67-4a2c-8a70-a7db07eb5a4a is already attached to instances: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 Aug 05 20:10:41.435709 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:10:41.435709 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-cbbf97e5-4785-463b-8208-2fdca0083524 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Returning 400 to user: Invalid volume: volume 700ac612-fd67-4a2c-8a70-a7db07eb5a4a is already attached to instances: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:10:41.435709 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-cbbf97e5-4785-463b-8208-2fdca0083524 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "POST /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100479 Aug 05 20:10:41.435709 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 387/798] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Aug 5 20:10:41 2022] POST /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 20:10:41.440374 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-450be7cb-7988-4047-9a63-2f88a14be0ea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:41.441353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-450be7cb-7988-4047-9a63-2f88a14be0ea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:41.447557 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-450be7cb-7988-4047-9a63-2f88a14be0ea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:41.448036 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-450be7cb-7988-4047-9a63-2f88a14be0ea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:41.448471 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-450be7cb-7988-4047-9a63-2f88a14be0ea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:41.449321 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-450be7cb-7988-4047-9a63-2f88a14be0ea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:41.449776 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-450be7cb-7988-4047-9a63-2f88a14be0ea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:41.450199 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-450be7cb-7988-4047-9a63-2f88a14be0ea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:41.475164 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-450be7cb-7988-4047-9a63-2f88a14be0ea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Going to try to terminate instance {{(pid=118192) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:10:41.552839 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-450be7cb-7988-4047-9a63-2f88a14be0ea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 204 len: 0 microversion: 2.1 time: 0.116112 Aug 05 20:10:41.553866 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 412/799] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:10:41 2022] DELETE /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:10:41.562955 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-44cacebe-c9a8-476b-a805-ec34ec234f1d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:41.563562 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-44cacebe-c9a8-476b-a805-ec34ec234f1d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:41.570842 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-44cacebe-c9a8-476b-a805-ec34ec234f1d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:41.572274 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-44cacebe-c9a8-476b-a805-ec34ec234f1d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:41.572764 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-44cacebe-c9a8-476b-a805-ec34ec234f1d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:41.573482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-44cacebe-c9a8-476b-a805-ec34ec234f1d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:41.573944 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-44cacebe-c9a8-476b-a805-ec34ec234f1d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:41.574376 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-44cacebe-c9a8-476b-a805-ec34ec234f1d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:41.625162 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-01583ed8-f9c3-4f32-85ac-7b3a42b2cd8e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:41.626165 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-01583ed8-f9c3-4f32-85ac-7b3a42b2cd8e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:41.633509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-01583ed8-f9c3-4f32-85ac-7b3a42b2cd8e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:41.634143 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-01583ed8-f9c3-4f32-85ac-7b3a42b2cd8e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:41.634887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-01583ed8-f9c3-4f32-85ac-7b3a42b2cd8e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:41.635640 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-01583ed8-f9c3-4f32-85ac-7b3a42b2cd8e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:41.636102 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-01583ed8-f9c3-4f32-85ac-7b3a42b2cd8e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:41.636528 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-01583ed8-f9c3-4f32-85ac-7b3a42b2cd8e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:41.749230 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-44cacebe-c9a8-476b-a805-ec34ec234f1d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:41.757261 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-44cacebe-c9a8-476b-a805-ec34ec234f1d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1680 microversion: 2.1 time: 0.198149 Aug 05 20:10:41.757940 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 388/800] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:41 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1680 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:41.807933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-01583ed8-f9c3-4f32-85ac-7b3a42b2cd8e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:41.815826 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-01583ed8-f9c3-4f32-85ac-7b3a42b2cd8e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1757 microversion: 2.1 time: 0.195919 Aug 05 20:10:41.816378 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 413/801] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:41 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1757 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:41.878778 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:10:41.878983 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Fri Aug 5 20:10:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:10:42.779303 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-36240178-fbed-4505-9929-85167aafb90a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:42.780057 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-36240178-fbed-4505-9929-85167aafb90a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:42.787383 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-36240178-fbed-4505-9929-85167aafb90a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:42.787891 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-36240178-fbed-4505-9929-85167aafb90a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:42.788317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-36240178-fbed-4505-9929-85167aafb90a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:42.789030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-36240178-fbed-4505-9929-85167aafb90a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:42.790121 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-36240178-fbed-4505-9929-85167aafb90a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:42.790449 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-36240178-fbed-4505-9929-85167aafb90a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:42.837331 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4e44b6cf-0493-4b96-9eac-adc9018a6d15 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:42.837942 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-4e44b6cf-0493-4b96-9eac-adc9018a6d15 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:42.844603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4e44b6cf-0493-4b96-9eac-adc9018a6d15 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:42.845090 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4e44b6cf-0493-4b96-9eac-adc9018a6d15 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:42.845521 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4e44b6cf-0493-4b96-9eac-adc9018a6d15 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:42.846211 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4e44b6cf-0493-4b96-9eac-adc9018a6d15 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:42.846659 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4e44b6cf-0493-4b96-9eac-adc9018a6d15 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:42.847082 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4e44b6cf-0493-4b96-9eac-adc9018a6d15 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:42.980710 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-36240178-fbed-4505-9929-85167aafb90a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:42.988470 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-36240178-fbed-4505-9929-85167aafb90a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1680 microversion: 2.1 time: 0.213168 Aug 05 20:10:42.989074 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 389/802] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:42 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1680 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:43.033923 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-4e44b6cf-0493-4b96-9eac-adc9018a6d15 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:43.042762 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-4e44b6cf-0493-4b96-9eac-adc9018a6d15 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1757 microversion: 2.1 time: 0.209514 Aug 05 20:10:43.043303 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 414/803] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:42 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1757 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:44.010157 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-6bf019b5-f1c6-48dd-8261-4c8c3105142d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:44.010879 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-6bf019b5-f1c6-48dd-8261-4c8c3105142d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:44.017744 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6bf019b5-f1c6-48dd-8261-4c8c3105142d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:44.018232 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6bf019b5-f1c6-48dd-8261-4c8c3105142d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:44.018669 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6bf019b5-f1c6-48dd-8261-4c8c3105142d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:44.019393 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6bf019b5-f1c6-48dd-8261-4c8c3105142d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:44.019849 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6bf019b5-f1c6-48dd-8261-4c8c3105142d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:44.020308 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6bf019b5-f1c6-48dd-8261-4c8c3105142d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:44.035877 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=100 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:10:44.063223 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-c8f6ed5f-4b3a-4683-8f20-1b5821f2a967 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:44.063954 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-c8f6ed5f-4b3a-4683-8f20-1b5821f2a967 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:44.071165 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c8f6ed5f-4b3a-4683-8f20-1b5821f2a967 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:44.071659 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c8f6ed5f-4b3a-4683-8f20-1b5821f2a967 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:44.072199 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c8f6ed5f-4b3a-4683-8f20-1b5821f2a967 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:44.072933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c8f6ed5f-4b3a-4683-8f20-1b5821f2a967 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:44.073382 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c8f6ed5f-4b3a-4683-8f20-1b5821f2a967 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:44.073806 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c8f6ed5f-4b3a-4683-8f20-1b5821f2a967 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:44.211680 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-6bf019b5-f1c6-48dd-8261-4c8c3105142d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:44.219717 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-6bf019b5-f1c6-48dd-8261-4c8c3105142d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1680 microversion: 2.1 time: 0.213635 Aug 05 20:10:44.220299 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 390/804] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:44 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1680 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:44.256099 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-c8f6ed5f-4b3a-4683-8f20-1b5821f2a967 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:44.264623 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-c8f6ed5f-4b3a-4683-8f20-1b5821f2a967 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1760 microversion: 2.1 time: 0.205102 Aug 05 20:10:44.265112 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 415/805] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:44 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1760 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:45.241721 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3f1b392a-68a0-4460-bd19-6e5badd283bb tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:45.243613 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-3f1b392a-68a0-4460-bd19-6e5badd283bb tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:45.250444 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3f1b392a-68a0-4460-bd19-6e5badd283bb tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:45.250740 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3f1b392a-68a0-4460-bd19-6e5badd283bb tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:45.251175 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3f1b392a-68a0-4460-bd19-6e5badd283bb tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:45.251896 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3f1b392a-68a0-4460-bd19-6e5badd283bb tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:45.253007 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3f1b392a-68a0-4460-bd19-6e5badd283bb tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:45.253007 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3f1b392a-68a0-4460-bd19-6e5badd283bb tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:45.327057 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3f1b392a-68a0-4460-bd19-6e5badd283bb tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:45.335380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3f1b392a-68a0-4460-bd19-6e5badd283bb tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 200 len: 1613 microversion: 2.1 time: 0.097354 Aug 05 20:10:45.335717 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 391/806] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:45 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 1613 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:45.396956 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-78e73f55-0746-4158-bc9b-d130717d416f req-d509d533-f8f0-42f0-82bc-325ec162598c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c68719b-222e-48b2-9ce7-55ed27758263", "name": "network-vif-deleted", "tag": "89f7c436-de82-4f40-b012-4d72c8fefa77"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:45.408205 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-78e73f55-0746-4158-bc9b-d130717d416f req-d509d533-f8f0-42f0-82bc-325ec162598c service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:45.408797 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-78e73f55-0746-4158-bc9b-d130717d416f req-d509d533-f8f0-42f0-82bc-325ec162598c service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:45.409257 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-78e73f55-0746-4158-bc9b-d130717d416f req-d509d533-f8f0-42f0-82bc-325ec162598c service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:45.422516 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-78e73f55-0746-4158-bc9b-d130717d416f req-d509d533-f8f0-42f0-82bc-325ec162598c service nova] Creating event network-vif-deleted:89f7c436-de82-4f40-b012-4d72c8fefa77 for instance 2c68719b-222e-48b2-9ce7-55ed27758263 on hv-cinder-85221 Aug 05 20:10:45.429390 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-78e73f55-0746-4158-bc9b-d130717d416f req-d509d533-f8f0-42f0-82bc-325ec162598c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037087 Aug 05 20:10:45.431127 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 416/807] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:10:46.358987 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e820394e-2529-4d8b-a7b7-6875fcb9c576 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:46.359779 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e820394e-2529-4d8b-a7b7-6875fcb9c576 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:46.368042 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e820394e-2529-4d8b-a7b7-6875fcb9c576 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:46.368873 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e820394e-2529-4d8b-a7b7-6875fcb9c576 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:46.369398 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e820394e-2529-4d8b-a7b7-6875fcb9c576 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:46.370433 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e820394e-2529-4d8b-a7b7-6875fcb9c576 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:46.371003 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e820394e-2529-4d8b-a7b7-6875fcb9c576 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:46.371492 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e820394e-2529-4d8b-a7b7-6875fcb9c576 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:46.387167 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-e820394e-2529-4d8b-a7b7-6875fcb9c576 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] HTTP exception thrown: Instance 2c68719b-222e-48b2-9ce7-55ed27758263 could not be found. Aug 05 20:10:46.388816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e820394e-2529-4d8b-a7b7-6875fcb9c576 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Request method failure captured: Aug 05 20:10:46.388816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 HTTP/1.1 Aug 05 20:10:46.388816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:10:46.388816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:10:46.388816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:10:46.388816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:10:46.388816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:10:46.388816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:10:46.388816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:10:46.388816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:10:46.388816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XdntYBLdlzvV7cyFg7UZC73a9OJV17dQagpc389c8g9F6eau2Yker8zNfrWRXvHE1X0s0ayqdbHqjuJX7Cxd2dg4OAmYf40eOt9KRb9kWilSf-b7MsgEH66CO1Uwzjbe3hC1fmQKpJ9W4mMdw5ek_dNUUbduEc7m-XkxS7A18A4T74 Aug 05 20:10:46.388816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:10:46.388816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:10:46.388816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:10:46.388816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:10:46.388816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:10:46.388816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:10:46.388816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:10:46.388816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:10:46.388816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:10:46.388816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:10:46.390513 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5b265913f9bd46b9b36c18d567d0cf66", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:10:46.390513 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:10:46.390513 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:10:46.390513 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:10:46.390513 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:10:46.390513 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:10:46.390513 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:10:46.390513 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: 1afe13c8fbb1468b8ef3d0d0c671208d Aug 05 20:10:46.390513 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:10:46.390513 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: > Aug 05 20:10:46.390513 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Instance 2c68719b-222e-48b2-9ce7-55ed27758263 could not be found. Aug 05 20:10:46.390513 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'id': '2c68719b-222e-48b2-9ce7-55ed27758263'} Aug 05 20:10:46.391365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:10:46.391365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:10:46.391365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:10:46.391365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:10:46.391365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:10:46.391365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:10:46.391365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:10:46.391365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:10:46.391365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:10:46.391365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:10:46.391365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c68719b-222e-48b2-9ce7-55ed27758263 could not be found. Aug 05 20:10:46.391365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:10:46.391365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:10:46.391365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:10:46.391365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:10:46.391365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:10:46.391365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:10:46.391365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:10:46.391365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:10:46.391365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:10:46.393058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:10:46.393058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:10:46.393058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:10:46.393058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:10:46.393058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:10:46.393058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:10:46.393058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:10:46.393058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c68719b-222e-48b2-9ce7-55ed27758263 could not be found. Aug 05 20:10:46.393058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:10:46.393058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:10:46.393058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:10:46.393058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:10:46.393058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:10:46.393058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:10:46.393058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:10:46.393058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:10:46.393058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c68719b-222e-48b2-9ce7-55ed27758263 could not be found. Aug 05 20:10:46.393058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:10:46.395468 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e820394e-2529-4d8b-a7b7-6875fcb9c576 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Returning 404 to user: Instance 2c68719b-222e-48b2-9ce7-55ed27758263 could not be found. {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:10:46.395468 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e820394e-2529-4d8b-a7b7-6875fcb9c576 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 404 len: 111 microversion: 2.1 time: 0.036906 Aug 05 20:10:46.395468 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 392/808] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:46 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:10:46.402530 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-3d5687da-8044-4030-8bc8-02c95508337d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '.version_select at 0x7fe3e4489ee0>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:46.430015 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-3d5687da-8044-4030-8bc8-02c95508337d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1753882173" status: 202 len: 0 microversion: 2.1 time: 0.033813 Aug 05 20:10:46.431298 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 417/809] 10.222.0.39 () {58 vars in 1221 bytes} [Fri Aug 5 20:10:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1753882173 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:10:47.283904 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e50def11-45b3-4476-a845-765d9ab6545f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:47.284412 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e50def11-45b3-4476-a845-765d9ab6545f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:47.291442 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e50def11-45b3-4476-a845-765d9ab6545f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:47.291950 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e50def11-45b3-4476-a845-765d9ab6545f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:47.292392 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e50def11-45b3-4476-a845-765d9ab6545f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:47.293135 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e50def11-45b3-4476-a845-765d9ab6545f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:47.293613 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e50def11-45b3-4476-a845-765d9ab6545f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:47.294077 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e50def11-45b3-4476-a845-765d9ab6545f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:47.399218 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.objects.instance [None req-e50def11-45b3-4476-a845-765d9ab6545f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lazy-loading 'services' on Instance uuid 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 {{(pid=118191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:10:47.523680 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e50def11-45b3-4476-a845-765d9ab6545f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "DELETE /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90/os-volume_attachments/700ac612-fd67-4a2c-8a70-a7db07eb5a4a" status: 202 len: 0 microversion: 2.1 time: 0.243058 Aug 05 20:10:47.524689 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 393/810] 10.222.0.39 () {58 vars in 1416 bytes} [Fri Aug 5 20:10:47 2022] DELETE /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90/os-volume_attachments/700ac612-fd67-4a2c-8a70-a7db07eb5a4a => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 20:10:47.539128 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-87becb9f-3bca-4192-8707-90fc76b20eb8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:47.542773 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-87becb9f-3bca-4192-8707-90fc76b20eb8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:47.553769 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-87becb9f-3bca-4192-8707-90fc76b20eb8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:47.555154 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-87becb9f-3bca-4192-8707-90fc76b20eb8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:47.555953 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-87becb9f-3bca-4192-8707-90fc76b20eb8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:47.557432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-87becb9f-3bca-4192-8707-90fc76b20eb8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:47.558146 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-87becb9f-3bca-4192-8707-90fc76b20eb8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:47.558925 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-87becb9f-3bca-4192-8707-90fc76b20eb8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:47.613538 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-87becb9f-3bca-4192-8707-90fc76b20eb8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082018 Aug 05 20:10:47.614452 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 418/811] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Aug 5 20:10:47 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:10:48.628248 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-885bd48c-297c-4abd-aea9-176ff34695f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:48.630675 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-885bd48c-297c-4abd-aea9-176ff34695f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:48.639241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-885bd48c-297c-4abd-aea9-176ff34695f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:48.639771 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-885bd48c-297c-4abd-aea9-176ff34695f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:48.640212 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-885bd48c-297c-4abd-aea9-176ff34695f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:48.641131 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-885bd48c-297c-4abd-aea9-176ff34695f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:48.641597 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-885bd48c-297c-4abd-aea9-176ff34695f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:48.642028 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-885bd48c-297c-4abd-aea9-176ff34695f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:48.676232 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-885bd48c-297c-4abd-aea9-176ff34695f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052695 Aug 05 20:10:48.676959 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 394/812] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Aug 5 20:10:48 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:10:49.689516 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a20e30a8-30fa-4041-a470-adb80d8609c0 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:49.691671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a20e30a8-30fa-4041-a470-adb80d8609c0 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:49.699208 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a20e30a8-30fa-4041-a470-adb80d8609c0 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:49.699701 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a20e30a8-30fa-4041-a470-adb80d8609c0 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:49.700252 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a20e30a8-30fa-4041-a470-adb80d8609c0 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:49.700942 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a20e30a8-30fa-4041-a470-adb80d8609c0 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:49.701427 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a20e30a8-30fa-4041-a470-adb80d8609c0 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:49.701906 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a20e30a8-30fa-4041-a470-adb80d8609c0 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:49.732922 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a20e30a8-30fa-4041-a470-adb80d8609c0 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047404 Aug 05 20:10:49.733552 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 419/813] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Aug 5 20:10:49 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:10:49.803499 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-78dae383-d7e3-4777-a709-30f3d97f5189 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:49.804059 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-78dae383-d7e3-4777-a709-30f3d97f5189 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:49.811498 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-78dae383-d7e3-4777-a709-30f3d97f5189 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:49.812000 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-78dae383-d7e3-4777-a709-30f3d97f5189 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:49.812434 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-78dae383-d7e3-4777-a709-30f3d97f5189 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:49.813182 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-78dae383-d7e3-4777-a709-30f3d97f5189 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:49.813634 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-78dae383-d7e3-4777-a709-30f3d97f5189 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:49.814061 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-78dae383-d7e3-4777-a709-30f3d97f5189 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:49.842749 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-78dae383-d7e3-4777-a709-30f3d97f5189 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Going to try to terminate instance {{(pid=118191) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:10:49.941032 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-78dae383-d7e3-4777-a709-30f3d97f5189 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "DELETE /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 204 len: 0 microversion: 2.1 time: 0.140801 Aug 05 20:10:49.941767 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 395/814] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:10:49 2022] DELETE /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 05 20:10:49.953267 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-71078b9b-907d-4421-8bee-4128d354e2f7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:49.953972 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-71078b9b-907d-4421-8bee-4128d354e2f7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:49.960197 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-71078b9b-907d-4421-8bee-4128d354e2f7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:49.960785 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-71078b9b-907d-4421-8bee-4128d354e2f7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:49.961221 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-71078b9b-907d-4421-8bee-4128d354e2f7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:49.961927 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-71078b9b-907d-4421-8bee-4128d354e2f7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:49.962378 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-71078b9b-907d-4421-8bee-4128d354e2f7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:49.962801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-71078b9b-907d-4421-8bee-4128d354e2f7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:50.121765 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-71078b9b-907d-4421-8bee-4128d354e2f7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:50.129980 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-71078b9b-907d-4421-8bee-4128d354e2f7 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1682 microversion: 2.1 time: 0.181619 Aug 05 20:10:50.130559 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 420/815] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:49 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:51.154366 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-4ea094cb-74ee-4db4-8aef-a96dba2b5706 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:51.155170 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-4ea094cb-74ee-4db4-8aef-a96dba2b5706 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:51.161727 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4ea094cb-74ee-4db4-8aef-a96dba2b5706 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:51.162239 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4ea094cb-74ee-4db4-8aef-a96dba2b5706 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:51.162678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4ea094cb-74ee-4db4-8aef-a96dba2b5706 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:51.163431 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4ea094cb-74ee-4db4-8aef-a96dba2b5706 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:51.164535 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4ea094cb-74ee-4db4-8aef-a96dba2b5706 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:51.165385 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4ea094cb-74ee-4db4-8aef-a96dba2b5706 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:51.313538 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-4ea094cb-74ee-4db4-8aef-a96dba2b5706 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:51.321577 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-4ea094cb-74ee-4db4-8aef-a96dba2b5706 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1682 microversion: 2.1 time: 0.171341 Aug 05 20:10:51.322164 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 396/816] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:51 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:10:52.347526 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3b39b7c0-78d6-4124-afae-163312c933ea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:52.348677 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-3b39b7c0-78d6-4124-afae-163312c933ea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:52.356309 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3b39b7c0-78d6-4124-afae-163312c933ea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:52.356840 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3b39b7c0-78d6-4124-afae-163312c933ea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:52.357320 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3b39b7c0-78d6-4124-afae-163312c933ea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:52.357985 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3b39b7c0-78d6-4124-afae-163312c933ea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:52.358483 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3b39b7c0-78d6-4124-afae-163312c933ea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:52.358908 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3b39b7c0-78d6-4124-afae-163312c933ea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:52.443522 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3b39b7c0-78d6-4124-afae-163312c933ea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:52.452817 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3b39b7c0-78d6-4124-afae-163312c933ea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1614 microversion: 2.1 time: 0.109382 Aug 05 20:10:52.453808 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 397/817] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:52 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1614 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:52.525503 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-c3dc85b1-4d90-4646-94fd-6d2f32c081e2 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:52.526338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-c3dc85b1-4d90-4646-94fd-6d2f32c081e2 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:52.533278 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c3dc85b1-4d90-4646-94fd-6d2f32c081e2 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:52.533793 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c3dc85b1-4d90-4646-94fd-6d2f32c081e2 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:52.534233 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c3dc85b1-4d90-4646-94fd-6d2f32c081e2 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:52.534944 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c3dc85b1-4d90-4646-94fd-6d2f32c081e2 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:52.535397 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c3dc85b1-4d90-4646-94fd-6d2f32c081e2 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:52.535855 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c3dc85b1-4d90-4646-94fd-6d2f32c081e2 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:52.561697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.objects.instance [None req-c3dc85b1-4d90-4646-94fd-6d2f32c081e2 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lazy-loading 'flavor' on Instance uuid 5559da3c-05e6-432d-960c-67c53284cc54 {{(pid=118192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:10:52.652494 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-c3dc85b1-4d90-4646-94fd-6d2f32c081e2 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "POST /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54/action" status: 202 len: 0 microversion: 2.1 time: 0.353041 Aug 05 20:10:52.653035 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 421/818] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Aug 5 20:10:52 2022] POST /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:10:52.661800 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-0bc5081c-4287-4911-a92e-64b9ba2d341c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:52.662422 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-0bc5081c-4287-4911-a92e-64b9ba2d341c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:52.669332 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0bc5081c-4287-4911-a92e-64b9ba2d341c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:52.669890 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0bc5081c-4287-4911-a92e-64b9ba2d341c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:52.670334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0bc5081c-4287-4911-a92e-64b9ba2d341c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:52.671041 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0bc5081c-4287-4911-a92e-64b9ba2d341c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:52.671508 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0bc5081c-4287-4911-a92e-64b9ba2d341c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:52.671935 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0bc5081c-4287-4911-a92e-64b9ba2d341c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:52.889255 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-66d277d8-919c-45ef-83e7-ab280b71e5c7 req-697accf1-439f-4963-9299-ab598dc5a0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24ea172c-d11f-41e4-80d8-3f3e5f67cf90", "name": "network-vif-deleted", "tag": "9d6aae7f-84e8-487b-8606-59afea4d7fad"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:52.897116 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-0bc5081c-4287-4911-a92e-64b9ba2d341c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:52.908156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-66d277d8-919c-45ef-83e7-ab280b71e5c7 req-697accf1-439f-4963-9299-ab598dc5a0c5 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:52.908929 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-66d277d8-919c-45ef-83e7-ab280b71e5c7 req-697accf1-439f-4963-9299-ab598dc5a0c5 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:52.909535 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-66d277d8-919c-45ef-83e7-ab280b71e5c7 req-697accf1-439f-4963-9299-ab598dc5a0c5 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:52.918388 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-0bc5081c-4287-4911-a92e-64b9ba2d341c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1567 microversion: 2.1 time: 0.260236 Aug 05 20:10:52.919700 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 398/819] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:52 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:52.925522 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-66d277d8-919c-45ef-83e7-ab280b71e5c7 req-697accf1-439f-4963-9299-ab598dc5a0c5 service nova] Creating event network-vif-deleted:9d6aae7f-84e8-487b-8606-59afea4d7fad for instance 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 on hv-cinder-85221 Aug 05 20:10:52.932078 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-66d277d8-919c-45ef-83e7-ab280b71e5c7 req-697accf1-439f-4963-9299-ab598dc5a0c5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046750 Aug 05 20:10:52.932973 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 422/820] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:10:53.475188 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-fc4eb578-30fe-4004-b89e-922cc0e405c4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:53.476961 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-fc4eb578-30fe-4004-b89e-922cc0e405c4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:53.484789 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc4eb578-30fe-4004-b89e-922cc0e405c4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:53.485886 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc4eb578-30fe-4004-b89e-922cc0e405c4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:53.487314 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc4eb578-30fe-4004-b89e-922cc0e405c4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:53.490202 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc4eb578-30fe-4004-b89e-922cc0e405c4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:53.490760 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc4eb578-30fe-4004-b89e-922cc0e405c4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:53.491272 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc4eb578-30fe-4004-b89e-922cc0e405c4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:53.528005 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc4eb578-30fe-4004-b89e-922cc0e405c4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:53.528612 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc4eb578-30fe-4004-b89e-922cc0e405c4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:53.529050 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc4eb578-30fe-4004-b89e-922cc0e405c4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:53.529507 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.objects.instance [None req-fc4eb578-30fe-4004-b89e-922cc0e405c4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lazy-loading 'fault' on Instance uuid 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 {{(pid=118191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:10:53.575040 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-fc4eb578-30fe-4004-b89e-922cc0e405c4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:53.582712 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-fc4eb578-30fe-4004-b89e-922cc0e405c4 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 200 len: 1331 microversion: 2.1 time: 0.111351 Aug 05 20:10:53.583293 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 399/821] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:53 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 1331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:53.944322 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4ee427ff-2c5e-41bb-bb2b-5fe5611839af tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:53.947017 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-4ee427ff-2c5e-41bb-bb2b-5fe5611839af tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:53.954403 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4ee427ff-2c5e-41bb-bb2b-5fe5611839af tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:53.954403 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4ee427ff-2c5e-41bb-bb2b-5fe5611839af tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:53.955154 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4ee427ff-2c5e-41bb-bb2b-5fe5611839af tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:53.955435 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4ee427ff-2c5e-41bb-bb2b-5fe5611839af tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:53.955976 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4ee427ff-2c5e-41bb-bb2b-5fe5611839af tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:53.956400 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4ee427ff-2c5e-41bb-bb2b-5fe5611839af tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:54.109586 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-4ee427ff-2c5e-41bb-bb2b-5fe5611839af tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:54.117547 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-4ee427ff-2c5e-41bb-bb2b-5fe5611839af tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1567 microversion: 2.1 time: 0.179385 Aug 05 20:10:54.118127 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 423/822] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:53 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:54.605525 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9051ba88-d840-4917-a12e-036696433bb2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:54.606146 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-9051ba88-d840-4917-a12e-036696433bb2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:54.612531 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9051ba88-d840-4917-a12e-036696433bb2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:54.613040 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9051ba88-d840-4917-a12e-036696433bb2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:54.613471 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9051ba88-d840-4917-a12e-036696433bb2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:54.614212 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9051ba88-d840-4917-a12e-036696433bb2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:54.614696 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9051ba88-d840-4917-a12e-036696433bb2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:54.615133 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9051ba88-d840-4917-a12e-036696433bb2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:54.630273 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-9051ba88-d840-4917-a12e-036696433bb2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] HTTP exception thrown: Instance 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 could not be found. Aug 05 20:10:54.633090 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9051ba88-d840-4917-a12e-036696433bb2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Request method failure captured: Aug 05 20:10:54.633090 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 HTTP/1.1 Aug 05 20:10:54.633090 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:10:54.633090 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:10:54.633090 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:10:54.633090 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:10:54.633090 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:10:54.633090 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:10:54.633090 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:10:54.633090 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:10:54.633090 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XdntYBLdlzvV7cyFg7UZC73a9OJV17dQagpc389c8g9F6eau2Yker8zNfrWRXvHE1X0s0ayqdbHqjuJX7Cxd2dg4OAmYf40eOt9KRb9kWilSf-b7MsgEH66CO1Uwzjbe3hC1fmQKpJ9W4mMdw5ek_dNUUbduEc7m-XkxS7A18A4T74 Aug 05 20:10:54.633090 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:10:54.633090 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:10:54.633090 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:10:54.633090 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:10:54.633090 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:10:54.633090 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:10:54.633090 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:10:54.633090 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:10:54.633090 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:10:54.633090 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:10:54.635558 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5b265913f9bd46b9b36c18d567d0cf66", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:10:54.635558 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:10:54.635558 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:10:54.635558 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:10:54.635558 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:10:54.635558 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:10:54.635558 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:10:54.635558 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: 1afe13c8fbb1468b8ef3d0d0c671208d Aug 05 20:10:54.635558 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:10:54.635558 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: > Aug 05 20:10:54.635558 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Instance 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 could not be found. Aug 05 20:10:54.635558 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'id': '24ea172c-d11f-41e4-80d8-3f3e5f67cf90'} Aug 05 20:10:54.636334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:10:54.636334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:10:54.636334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:10:54.636334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:10:54.636334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:10:54.636334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:10:54.636334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:10:54.636334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:10:54.636334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:10:54.636334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:10:54.636334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 could not be found. Aug 05 20:10:54.636334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:10:54.636334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:10:54.636334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:10:54.636334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:10:54.636334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:10:54.636334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:10:54.636334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:10:54.636334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:10:54.636334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:10:54.637585 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:10:54.637585 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:10:54.637585 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:10:54.637585 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:10:54.637585 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:10:54.637585 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:10:54.637585 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:10:54.637585 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 could not be found. Aug 05 20:10:54.637585 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:10:54.637585 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:10:54.637585 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:10:54.637585 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:10:54.637585 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:10:54.637585 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:10:54.637585 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:10:54.637585 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:10:54.637585 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 could not be found. Aug 05 20:10:54.637585 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:10:54.638948 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9051ba88-d840-4917-a12e-036696433bb2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Returning 404 to user: Instance 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 could not be found. {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:10:54.638948 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-9051ba88-d840-4917-a12e-036696433bb2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 404 len: 111 microversion: 2.1 time: 0.035506 Aug 05 20:10:54.638948 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 400/823] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:54 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:10:54.645865 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4f9c5251-71f9-4a7b-ba94-59100bf01477 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '.version_select at 0x7fe3e442dc10>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:54.666933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-4f9c5251-71f9-4a7b-ba94-59100bf01477 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-504048960" status: 202 len: 0 microversion: 2.1 time: 0.024809 Aug 05 20:10:54.667650 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 424/824] 10.222.0.39 () {58 vars in 1218 bytes} [Fri Aug 5 20:10:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-504048960 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:10:55.141146 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-5f1d167a-68ad-48d0-8568-78737a4c2f94 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:55.141867 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-5f1d167a-68ad-48d0-8568-78737a4c2f94 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:55.149392 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5f1d167a-68ad-48d0-8568-78737a4c2f94 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:55.149886 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5f1d167a-68ad-48d0-8568-78737a4c2f94 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:55.150473 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5f1d167a-68ad-48d0-8568-78737a4c2f94 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:55.151181 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5f1d167a-68ad-48d0-8568-78737a4c2f94 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:55.151632 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5f1d167a-68ad-48d0-8568-78737a4c2f94 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:55.152055 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5f1d167a-68ad-48d0-8568-78737a4c2f94 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:55.302110 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-5f1d167a-68ad-48d0-8568-78737a4c2f94 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:55.311806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-5f1d167a-68ad-48d0-8568-78737a4c2f94 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1567 microversion: 2.1 time: 0.175779 Aug 05 20:10:55.322012 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 401/825] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:55 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:55.340239 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-c615d01a-c351-4022-8e35-2686cdbf0c3d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Action: 'create', calling method: .version_select at 0x7fe3e4489790>, body: {"keypair": {"name": "tempest-keypair-841158896", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVAp6o7Z1eKm8FqaJci9nW5KjYXbasJNvPJxz3VGpKGaMvRKkkCO2jhKdsmbYjD+QPkuH0Y40WNoiy2+SMD8VXvR1+bqJJw6wvSx0WuvJfn08MJJv61+uCF0W4Km3MP/Q=="}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:55.356750 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-c615d01a-c351-4022-8e35-2686cdbf0c3d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Getting quotas for project 5b265913f9bd46b9b36c18d567d0cf66. Resources: {'key_pairs'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:10:55.360851 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-c615d01a-c351-4022-8e35-2686cdbf0c3d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Getting quotas for user 1afe13c8fbb1468b8ef3d0d0c671208d and project 5b265913f9bd46b9b36c18d567d0cf66. Resources: {'key_pairs'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:10:55.386975 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-c615d01a-c351-4022-8e35-2686cdbf0c3d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052008 Aug 05 20:10:55.387590 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 425/826] 10.222.0.39 () {60 vars in 1159 bytes} [Fri Aug 5 20:10:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:10:56.339585 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-def40394-4dc6-4f59-9e78-f7c40ce974a1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:56.340694 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-def40394-4dc6-4f59-9e78-f7c40ce974a1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:56.349683 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-def40394-4dc6-4f59-9e78-f7c40ce974a1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:56.350283 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-def40394-4dc6-4f59-9e78-f7c40ce974a1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:56.351803 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-def40394-4dc6-4f59-9e78-f7c40ce974a1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:56.353190 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-def40394-4dc6-4f59-9e78-f7c40ce974a1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:56.354047 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-def40394-4dc6-4f59-9e78-f7c40ce974a1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:56.354815 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-def40394-4dc6-4f59-9e78-f7c40ce974a1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:56.568162 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-def40394-4dc6-4f59-9e78-f7c40ce974a1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:56.578381 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-def40394-4dc6-4f59-9e78-f7c40ce974a1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1567 microversion: 2.1 time: 0.246202 Aug 05 20:10:56.579291 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 402/827] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:56 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:56.896640 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-db66ad34-45e2-49c5-9880-b1f205867323 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-852004305", "imageRef": "c148255e-9574-4d10-b9bb-13c9411eda77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d7536c13-8fba-4a9d-87ec-6a7bf401477c"}], "security_groups": [{"name": "tempest-securitygroup--108913584"}], "key_name": "tempest-keypair-841158896", "user_data": "}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:10:57.001717 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.network.neutron [None req-db66ad34-45e2-49c5-9880-b1f205867323 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] validate_networks() for [('d7536c13-8fba-4a9d-87ec-6a7bf401477c', None, None, None, None, None)] {{(pid=118192) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:10:57.404359 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-db66ad34-45e2-49c5-9880-b1f205867323 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Flavor limits 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:10:57.404814 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-db66ad34-45e2-49c5-9880-b1f205867323 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Image limits 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:10:57.405317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-db66ad34-45e2-49c5-9880-b1f205867323 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Flavor pref 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:10:57.405753 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-db66ad34-45e2-49c5-9880-b1f205867323 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Image pref 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:10:57.406162 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-db66ad34-45e2-49c5-9880-b1f205867323 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:10:57.415443 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-db66ad34-45e2-49c5-9880-b1f205867323 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:57.416462 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-db66ad34-45e2-49c5-9880-b1f205867323 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:57.416948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-db66ad34-45e2-49c5-9880-b1f205867323 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:57.417676 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-db66ad34-45e2-49c5-9880-b1f205867323 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:57.418126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-db66ad34-45e2-49c5-9880-b1f205867323 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:57.418548 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-db66ad34-45e2-49c5-9880-b1f205867323 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:57.434895 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-db66ad34-45e2-49c5-9880-b1f205867323 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Getting quotas for project 5b265913f9bd46b9b36c18d567d0cf66. Resources: {'cores', 'ram', 'instances'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:10:57.438836 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-db66ad34-45e2-49c5-9880-b1f205867323 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Getting quotas for user 1afe13c8fbb1468b8ef3d0d0c671208d and project 5b265913f9bd46b9b36c18d567d0cf66. Resources: {'cores', 'ram', 'instances'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:10:57.449861 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-db66ad34-45e2-49c5-9880-b1f205867323 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Going to run 1 instances... {{(pid=118192) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:10:57.452102 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-db66ad34-45e2-49c5-9880-b1f205867323 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c148255e-9574-4d10-b9bb-13c9411eda77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:10:57.499369 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-db66ad34-45e2-49c5-9880-b1f205867323 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.607470 Aug 05 20:10:57.500006 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 426/828] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Aug 5 20:10:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:10:57.512958 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-cc776457-a93c-4cae-8978-0f7b0ea63c48 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:57.513579 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-cc776457-a93c-4cae-8978-0f7b0ea63c48 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:57.582519 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-cc776457-a93c-4cae-8978-0f7b0ea63c48 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:57.590221 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-cc776457-a93c-4cae-8978-0f7b0ea63c48 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb" status: 200 len: 1240 microversion: 2.1 time: 0.083116 Aug 05 20:10:57.590798 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 403/829] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:57 2022] GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:57.599938 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-22128d29-f96d-4e1c-9e15-a26ca784f432 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:57.600933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-22128d29-f96d-4e1c-9e15-a26ca784f432 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:57.607489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-22128d29-f96d-4e1c-9e15-a26ca784f432 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:57.607991 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-22128d29-f96d-4e1c-9e15-a26ca784f432 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:57.608435 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-22128d29-f96d-4e1c-9e15-a26ca784f432 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:57.609175 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-22128d29-f96d-4e1c-9e15-a26ca784f432 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:57.609636 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-22128d29-f96d-4e1c-9e15-a26ca784f432 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:57.610066 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-22128d29-f96d-4e1c-9e15-a26ca784f432 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:57.751555 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-22128d29-f96d-4e1c-9e15-a26ca784f432 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:57.765181 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-22128d29-f96d-4e1c-9e15-a26ca784f432 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1567 microversion: 2.1 time: 0.169268 Aug 05 20:10:57.766612 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 427/830] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:57 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:58.611274 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-ad1af572-cbfb-4881-b28d-037027bf958e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:58.611889 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-ad1af572-cbfb-4881-b28d-037027bf958e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:58.619084 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ad1af572-cbfb-4881-b28d-037027bf958e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:58.619578 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ad1af572-cbfb-4881-b28d-037027bf958e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:58.620014 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ad1af572-cbfb-4881-b28d-037027bf958e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:58.620746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ad1af572-cbfb-4881-b28d-037027bf958e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:58.621204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ad1af572-cbfb-4881-b28d-037027bf958e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:58.621640 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ad1af572-cbfb-4881-b28d-037027bf958e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:58.686827 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-ad1af572-cbfb-4881-b28d-037027bf958e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:58.694461 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-ad1af572-cbfb-4881-b28d-037027bf958e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb" status: 200 len: 1292 microversion: 2.1 time: 0.087161 Aug 05 20:10:58.695028 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 404/831] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:58 2022] GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb => generated 1292 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:58.789230 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-0fd78f34-299b-464d-8085-be32c038ec42 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:58.790267 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-0fd78f34-299b-464d-8085-be32c038ec42 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:58.798066 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0fd78f34-299b-464d-8085-be32c038ec42 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:58.798903 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0fd78f34-299b-464d-8085-be32c038ec42 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:58.799360 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0fd78f34-299b-464d-8085-be32c038ec42 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:58.800118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0fd78f34-299b-464d-8085-be32c038ec42 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:58.800599 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0fd78f34-299b-464d-8085-be32c038ec42 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:58.801040 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0fd78f34-299b-464d-8085-be32c038ec42 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:59.010488 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-0fd78f34-299b-464d-8085-be32c038ec42 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:59.017975 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-0fd78f34-299b-464d-8085-be32c038ec42 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1567 microversion: 2.1 time: 0.234058 Aug 05 20:10:59.018535 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 428/832] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:58 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:10:59.716764 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a76894e4-4401-4bc3-a6a0-c7342277e428 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:10:59.717591 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-a76894e4-4401-4bc3-a6a0-c7342277e428 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:10:59.729874 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a76894e4-4401-4bc3-a6a0-c7342277e428 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:59.730641 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a76894e4-4401-4bc3-a6a0-c7342277e428 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:59.731341 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a76894e4-4401-4bc3-a6a0-c7342277e428 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:59.732311 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a76894e4-4401-4bc3-a6a0-c7342277e428 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:10:59.733270 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a76894e4-4401-4bc3-a6a0-c7342277e428 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:10:59.733939 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a76894e4-4401-4bc3-a6a0-c7342277e428 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:10:59.966417 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a76894e4-4401-4bc3-a6a0-c7342277e428 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:10:59.973974 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-a76894e4-4401-4bc3-a6a0-c7342277e428 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb" status: 200 len: 1365 microversion: 2.1 time: 0.261251 Aug 05 20:10:59.974561 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 405/833] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:10:59 2022] GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb => generated 1365 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:00.040426 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-d6847919-43cc-4c5f-818c-234a0933de7a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:00.041244 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-d6847919-43cc-4c5f-818c-234a0933de7a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:00.048333 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d6847919-43cc-4c5f-818c-234a0933de7a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:00.049093 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d6847919-43cc-4c5f-818c-234a0933de7a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:00.049538 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d6847919-43cc-4c5f-818c-234a0933de7a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:00.050252 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d6847919-43cc-4c5f-818c-234a0933de7a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:00.050707 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d6847919-43cc-4c5f-818c-234a0933de7a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:00.051235 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d6847919-43cc-4c5f-818c-234a0933de7a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:00.247153 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-d6847919-43cc-4c5f-818c-234a0933de7a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:00.249512 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:00.256167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-d6847919-43cc-4c5f-818c-234a0933de7a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1567 microversion: 2.1 time: 0.220364 Aug 05 20:11:00.256915 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 429/834] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:00 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:00.518279 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-ac041ced-707d-45a3-9baa-96adb439e5bf req-c0729942-3305-41ac-8b40-3af9f0a8a1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4539af4-0b20-4505-801a-6adb0b19cddb", "tag": "d953e10e-e397-4f7c-b322-32c965ba3c7a"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:00.528652 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-ac041ced-707d-45a3-9baa-96adb439e5bf req-c0729942-3305-41ac-8b40-3af9f0a8a1d7 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:00.529135 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-ac041ced-707d-45a3-9baa-96adb439e5bf req-c0729942-3305-41ac-8b40-3af9f0a8a1d7 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:00.529578 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-ac041ced-707d-45a3-9baa-96adb439e5bf req-c0729942-3305-41ac-8b40-3af9f0a8a1d7 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:00.541382 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-ac041ced-707d-45a3-9baa-96adb439e5bf req-c0729942-3305-41ac-8b40-3af9f0a8a1d7 service nova] Creating event network-changed:d953e10e-e397-4f7c-b322-32c965ba3c7a for instance f4539af4-0b20-4505-801a-6adb0b19cddb on hv-cinder-85221 Aug 05 20:11:00.546600 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-ac041ced-707d-45a3-9baa-96adb439e5bf req-c0729942-3305-41ac-8b40-3af9f0a8a1d7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032082 Aug 05 20:11:00.547206 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 406/835] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:00.995063 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-459eba50-21f0-4618-bf31-11e2f9101eec tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:00.995677 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-459eba50-21f0-4618-bf31-11e2f9101eec tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:01.002589 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-459eba50-21f0-4618-bf31-11e2f9101eec tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:01.003072 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-459eba50-21f0-4618-bf31-11e2f9101eec tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:01.003505 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-459eba50-21f0-4618-bf31-11e2f9101eec tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:01.004193 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-459eba50-21f0-4618-bf31-11e2f9101eec tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:01.004666 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-459eba50-21f0-4618-bf31-11e2f9101eec tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:01.005093 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-459eba50-21f0-4618-bf31-11e2f9101eec tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:01.146049 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-459eba50-21f0-4618-bf31-11e2f9101eec tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:01.155892 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-459eba50-21f0-4618-bf31-11e2f9101eec tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb" status: 200 len: 1365 microversion: 2.1 time: 0.164782 Aug 05 20:11:01.156458 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 430/836] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:00 2022] GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:01.281367 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e70d3174-6eda-43b4-85ec-2ab39e635641 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:01.282068 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e70d3174-6eda-43b4-85ec-2ab39e635641 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:01.288177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e70d3174-6eda-43b4-85ec-2ab39e635641 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:01.288708 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e70d3174-6eda-43b4-85ec-2ab39e635641 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:01.289266 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e70d3174-6eda-43b4-85ec-2ab39e635641 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:01.290635 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e70d3174-6eda-43b4-85ec-2ab39e635641 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:01.291103 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e70d3174-6eda-43b4-85ec-2ab39e635641 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:01.291540 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e70d3174-6eda-43b4-85ec-2ab39e635641 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:01.306490 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:01.429929 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e70d3174-6eda-43b4-85ec-2ab39e635641 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:01.437554 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e70d3174-6eda-43b4-85ec-2ab39e635641 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1567 microversion: 2.1 time: 0.161025 Aug 05 20:11:01.438126 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 407/837] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:01 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:02.176976 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-fc46abdf-b079-4b3a-b529-bb310175406e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:02.177612 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-fc46abdf-b079-4b3a-b529-bb310175406e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:02.184065 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fc46abdf-b079-4b3a-b529-bb310175406e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:02.184545 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fc46abdf-b079-4b3a-b529-bb310175406e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:02.185022 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fc46abdf-b079-4b3a-b529-bb310175406e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:02.185705 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fc46abdf-b079-4b3a-b529-bb310175406e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:02.186156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fc46abdf-b079-4b3a-b529-bb310175406e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:02.186573 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fc46abdf-b079-4b3a-b529-bb310175406e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:02.322852 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-fc46abdf-b079-4b3a-b529-bb310175406e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:02.330398 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-fc46abdf-b079-4b3a-b529-bb310175406e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb" status: 200 len: 1365 microversion: 2.1 time: 0.157382 Aug 05 20:11:02.330962 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 431/838] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:02 2022] GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:02.458397 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f7fb2c62-e417-418d-8fe5-7c8f293e06ed tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:02.458959 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f7fb2c62-e417-418d-8fe5-7c8f293e06ed tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:02.466009 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f7fb2c62-e417-418d-8fe5-7c8f293e06ed tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:02.466502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f7fb2c62-e417-418d-8fe5-7c8f293e06ed tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:02.466953 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f7fb2c62-e417-418d-8fe5-7c8f293e06ed tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:02.467647 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f7fb2c62-e417-418d-8fe5-7c8f293e06ed tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:02.468109 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f7fb2c62-e417-418d-8fe5-7c8f293e06ed tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:02.468539 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f7fb2c62-e417-418d-8fe5-7c8f293e06ed tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:02.599134 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f7fb2c62-e417-418d-8fe5-7c8f293e06ed tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:02.606867 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f7fb2c62-e417-418d-8fe5-7c8f293e06ed tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1567 microversion: 2.1 time: 0.152437 Aug 05 20:11:02.607437 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 408/839] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:02 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:03.352810 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-8aab1674-121c-4973-97b6-fa17a05fb9bf tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:03.353427 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-8aab1674-121c-4973-97b6-fa17a05fb9bf tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:03.359794 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8aab1674-121c-4973-97b6-fa17a05fb9bf tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:03.360281 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8aab1674-121c-4973-97b6-fa17a05fb9bf tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:03.360750 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8aab1674-121c-4973-97b6-fa17a05fb9bf tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:03.361439 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8aab1674-121c-4973-97b6-fa17a05fb9bf tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:03.361894 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8aab1674-121c-4973-97b6-fa17a05fb9bf tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:03.362319 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8aab1674-121c-4973-97b6-fa17a05fb9bf tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:03.494345 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-8aab1674-121c-4973-97b6-fa17a05fb9bf tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:03.501896 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-8aab1674-121c-4973-97b6-fa17a05fb9bf tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb" status: 200 len: 1365 microversion: 2.1 time: 0.153243 Aug 05 20:11:03.502450 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 432/840] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:03 2022] GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:03.628405 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-8a10d70c-08c0-4db4-b586-9f26fbac8b1b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:03.629046 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-8a10d70c-08c0-4db4-b586-9f26fbac8b1b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:03.636895 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8a10d70c-08c0-4db4-b586-9f26fbac8b1b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:03.637382 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8a10d70c-08c0-4db4-b586-9f26fbac8b1b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:03.637823 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8a10d70c-08c0-4db4-b586-9f26fbac8b1b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:03.638516 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8a10d70c-08c0-4db4-b586-9f26fbac8b1b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:03.638969 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8a10d70c-08c0-4db4-b586-9f26fbac8b1b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:03.639397 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8a10d70c-08c0-4db4-b586-9f26fbac8b1b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:03.769861 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8a10d70c-08c0-4db4-b586-9f26fbac8b1b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:03.777482 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-8a10d70c-08c0-4db4-b586-9f26fbac8b1b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1567 microversion: 2.1 time: 0.152960 Aug 05 20:11:03.778057 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 409/841] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:03 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:04.523787 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-410f48a0-d8e6-41c9-99ea-a1d8655a6b49 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:04.524410 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-410f48a0-d8e6-41c9-99ea-a1d8655a6b49 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:04.526718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:04.532284 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-410f48a0-d8e6-41c9-99ea-a1d8655a6b49 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:04.532805 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-410f48a0-d8e6-41c9-99ea-a1d8655a6b49 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:04.533263 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-410f48a0-d8e6-41c9-99ea-a1d8655a6b49 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:04.533950 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-410f48a0-d8e6-41c9-99ea-a1d8655a6b49 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:04.534409 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-410f48a0-d8e6-41c9-99ea-a1d8655a6b49 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:04.534832 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-410f48a0-d8e6-41c9-99ea-a1d8655a6b49 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:04.666762 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-410f48a0-d8e6-41c9-99ea-a1d8655a6b49 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:04.674113 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-410f48a0-d8e6-41c9-99ea-a1d8655a6b49 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb" status: 200 len: 1365 microversion: 2.1 time: 0.154376 Aug 05 20:11:04.674685 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 433/842] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:04 2022] GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:04.798069 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a6907719-949c-48ce-a03f-76b2d2e7fe38 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:04.798683 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-a6907719-949c-48ce-a03f-76b2d2e7fe38 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:04.806360 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a6907719-949c-48ce-a03f-76b2d2e7fe38 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:04.806845 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a6907719-949c-48ce-a03f-76b2d2e7fe38 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:04.807282 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a6907719-949c-48ce-a03f-76b2d2e7fe38 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:04.807975 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a6907719-949c-48ce-a03f-76b2d2e7fe38 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:04.808433 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a6907719-949c-48ce-a03f-76b2d2e7fe38 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:04.808886 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a6907719-949c-48ce-a03f-76b2d2e7fe38 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:04.945930 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a6907719-949c-48ce-a03f-76b2d2e7fe38 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:04.953620 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-a6907719-949c-48ce-a03f-76b2d2e7fe38 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1567 microversion: 2.1 time: 0.159407 Aug 05 20:11:04.954194 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 410/843] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:04 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:05.695742 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-d33378b7-b160-48bb-a59b-f14fa129df14 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:05.696422 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-d33378b7-b160-48bb-a59b-f14fa129df14 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:05.703358 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d33378b7-b160-48bb-a59b-f14fa129df14 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:05.703840 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d33378b7-b160-48bb-a59b-f14fa129df14 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:05.704316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d33378b7-b160-48bb-a59b-f14fa129df14 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:05.705020 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d33378b7-b160-48bb-a59b-f14fa129df14 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:05.705471 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d33378b7-b160-48bb-a59b-f14fa129df14 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:05.705898 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d33378b7-b160-48bb-a59b-f14fa129df14 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:05.836901 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-d33378b7-b160-48bb-a59b-f14fa129df14 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:05.844548 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-d33378b7-b160-48bb-a59b-f14fa129df14 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb" status: 200 len: 1365 microversion: 2.1 time: 0.153149 Aug 05 20:11:05.845138 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 434/844] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:05 2022] GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:05.975281 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-cade7e9a-d85b-48c4-8d1d-f5b1e32c4caf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:05.975902 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-cade7e9a-d85b-48c4-8d1d-f5b1e32c4caf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:05.983013 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cade7e9a-d85b-48c4-8d1d-f5b1e32c4caf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:05.983505 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cade7e9a-d85b-48c4-8d1d-f5b1e32c4caf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:05.983944 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cade7e9a-d85b-48c4-8d1d-f5b1e32c4caf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:05.984671 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cade7e9a-d85b-48c4-8d1d-f5b1e32c4caf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:05.985130 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cade7e9a-d85b-48c4-8d1d-f5b1e32c4caf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:05.985558 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cade7e9a-d85b-48c4-8d1d-f5b1e32c4caf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:06.122091 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-cade7e9a-d85b-48c4-8d1d-f5b1e32c4caf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:06.137295 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-cade7e9a-d85b-48c4-8d1d-f5b1e32c4caf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1567 microversion: 2.1 time: 0.165789 Aug 05 20:11:06.137787 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 411/845] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:05 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:06.865566 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ec5f34d6-a1c3-4445-8fed-256330da7275 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:06.866103 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-ec5f34d6-a1c3-4445-8fed-256330da7275 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:06.872542 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ec5f34d6-a1c3-4445-8fed-256330da7275 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:06.873051 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ec5f34d6-a1c3-4445-8fed-256330da7275 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:06.873489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ec5f34d6-a1c3-4445-8fed-256330da7275 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:06.874171 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ec5f34d6-a1c3-4445-8fed-256330da7275 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:06.874619 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ec5f34d6-a1c3-4445-8fed-256330da7275 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:06.875036 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ec5f34d6-a1c3-4445-8fed-256330da7275 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:07.004797 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-ec5f34d6-a1c3-4445-8fed-256330da7275 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:07.013134 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-ec5f34d6-a1c3-4445-8fed-256330da7275 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb" status: 200 len: 1365 microversion: 2.1 time: 0.151514 Aug 05 20:11:07.013714 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 435/846] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:06 2022] GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:07.163317 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-42909d4f-43a3-4f23-bc9c-f4802debdfaf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:07.163924 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-42909d4f-43a3-4f23-bc9c-f4802debdfaf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:07.170516 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-42909d4f-43a3-4f23-bc9c-f4802debdfaf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:07.171015 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-42909d4f-43a3-4f23-bc9c-f4802debdfaf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:07.171428 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-42909d4f-43a3-4f23-bc9c-f4802debdfaf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:07.172112 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-42909d4f-43a3-4f23-bc9c-f4802debdfaf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:07.172561 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-42909d4f-43a3-4f23-bc9c-f4802debdfaf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:07.173004 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-42909d4f-43a3-4f23-bc9c-f4802debdfaf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:07.303673 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-42909d4f-43a3-4f23-bc9c-f4802debdfaf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:07.311978 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-42909d4f-43a3-4f23-bc9c-f4802debdfaf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1567 microversion: 2.1 time: 0.152494 Aug 05 20:11:07.312550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 412/847] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:07 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:08.034498 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4a05bc50-6810-490b-9bde-383b2238edf2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:08.035188 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-4a05bc50-6810-490b-9bde-383b2238edf2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:08.036955 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell0:SELECT=2 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:08.037619 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell0:SELECT=10 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:08.044345 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-d730d0cd-beb4-440d-805c-6529d2ed4027 req-21e824d0-2266-462b-abc3-6f3b7b91fef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4539af4-0b20-4505-801a-6adb0b19cddb", "name": "network-vif-plugged", "status": "completed", "tag": "d953e10e-e397-4f7c-b322-32c965ba3c7a"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:08.045323 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4a05bc50-6810-490b-9bde-383b2238edf2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:08.045824 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4a05bc50-6810-490b-9bde-383b2238edf2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:08.046265 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4a05bc50-6810-490b-9bde-383b2238edf2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:08.046976 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4a05bc50-6810-490b-9bde-383b2238edf2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:08.047437 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4a05bc50-6810-490b-9bde-383b2238edf2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:08.047870 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4a05bc50-6810-490b-9bde-383b2238edf2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:08.050347 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=2 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:08.056755 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-d730d0cd-beb4-440d-805c-6529d2ed4027 req-21e824d0-2266-462b-abc3-6f3b7b91fef6 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:08.057254 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-d730d0cd-beb4-440d-805c-6529d2ed4027 req-21e824d0-2266-462b-abc3-6f3b7b91fef6 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:08.057772 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-d730d0cd-beb4-440d-805c-6529d2ed4027 req-21e824d0-2266-462b-abc3-6f3b7b91fef6 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:08.069802 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-d730d0cd-beb4-440d-805c-6529d2ed4027 req-21e824d0-2266-462b-abc3-6f3b7b91fef6 service nova] Creating event network-vif-plugged:d953e10e-e397-4f7c-b322-32c965ba3c7a for instance f4539af4-0b20-4505-801a-6adb0b19cddb on hv-cinder-85221 Aug 05 20:11:08.075344 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-d730d0cd-beb4-440d-805c-6529d2ed4027 req-21e824d0-2266-462b-abc3-6f3b7b91fef6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036098 Aug 05 20:11:08.076160 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 413/848] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:11:08.334812 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-1276e57e-009e-49c2-a773-7e59a9601f7c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:08.335524 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-1276e57e-009e-49c2-a773-7e59a9601f7c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:08.342408 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1276e57e-009e-49c2-a773-7e59a9601f7c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:08.342901 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1276e57e-009e-49c2-a773-7e59a9601f7c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:08.343373 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1276e57e-009e-49c2-a773-7e59a9601f7c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:08.344080 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1276e57e-009e-49c2-a773-7e59a9601f7c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:08.344537 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1276e57e-009e-49c2-a773-7e59a9601f7c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:08.344993 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1276e57e-009e-49c2-a773-7e59a9601f7c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:08.505823 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-4a05bc50-6810-490b-9bde-383b2238edf2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:08.514308 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-4a05bc50-6810-490b-9bde-383b2238edf2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb" status: 200 len: 1365 microversion: 2.1 time: 0.483566 Aug 05 20:11:08.514890 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 436/849] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:08 2022] GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb => generated 1365 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:08.587604 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-1276e57e-009e-49c2-a773-7e59a9601f7c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:08.595727 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-1276e57e-009e-49c2-a773-7e59a9601f7c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1567 microversion: 2.1 time: 0.265682 Aug 05 20:11:08.596309 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 414/850] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:08 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1567 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:09.535761 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-7293e3a5-4448-44d7-aace-711c6b5f1305 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:09.536372 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-7293e3a5-4448-44d7-aace-711c6b5f1305 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:09.543076 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7293e3a5-4448-44d7-aace-711c6b5f1305 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:09.543556 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7293e3a5-4448-44d7-aace-711c6b5f1305 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:09.543984 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7293e3a5-4448-44d7-aace-711c6b5f1305 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:09.544706 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7293e3a5-4448-44d7-aace-711c6b5f1305 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:09.545186 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7293e3a5-4448-44d7-aace-711c6b5f1305 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:09.545603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7293e3a5-4448-44d7-aace-711c6b5f1305 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:09.617466 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-5eeef1bf-d025-4dbd-a1a7-1ea9a4391abe tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:09.619008 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-5eeef1bf-d025-4dbd-a1a7-1ea9a4391abe tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:09.625815 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5eeef1bf-d025-4dbd-a1a7-1ea9a4391abe tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:09.626389 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5eeef1bf-d025-4dbd-a1a7-1ea9a4391abe tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:09.626892 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5eeef1bf-d025-4dbd-a1a7-1ea9a4391abe tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:09.627771 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5eeef1bf-d025-4dbd-a1a7-1ea9a4391abe tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:09.628255 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5eeef1bf-d025-4dbd-a1a7-1ea9a4391abe tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:09.628715 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5eeef1bf-d025-4dbd-a1a7-1ea9a4391abe tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:09.685396 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-7293e3a5-4448-44d7-aace-711c6b5f1305 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:09.692807 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-7293e3a5-4448-44d7-aace-711c6b5f1305 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb" status: 200 len: 1365 microversion: 2.1 time: 0.160968 Aug 05 20:11:09.693367 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 437/851] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:09 2022] GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:09.789685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-5eeef1bf-d025-4dbd-a1a7-1ea9a4391abe tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:09.797349 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-5eeef1bf-d025-4dbd-a1a7-1ea9a4391abe tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1567 microversion: 2.1 time: 0.183932 Aug 05 20:11:09.797918 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 415/852] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:09 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:10.715107 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-eb70ad6d-502a-47ac-9bc3-7519ce3d326e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:10.715760 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-eb70ad6d-502a-47ac-9bc3-7519ce3d326e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:10.722180 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eb70ad6d-502a-47ac-9bc3-7519ce3d326e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:10.722658 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eb70ad6d-502a-47ac-9bc3-7519ce3d326e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:10.723084 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eb70ad6d-502a-47ac-9bc3-7519ce3d326e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:10.723769 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eb70ad6d-502a-47ac-9bc3-7519ce3d326e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:10.724214 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eb70ad6d-502a-47ac-9bc3-7519ce3d326e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:10.724671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eb70ad6d-502a-47ac-9bc3-7519ce3d326e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:10.818868 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-0202c0e5-1cfa-4819-831d-a614d5c7cb3c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:10.819484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-0202c0e5-1cfa-4819-831d-a614d5c7cb3c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:10.822586 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:10.828914 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0202c0e5-1cfa-4819-831d-a614d5c7cb3c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:10.829442 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0202c0e5-1cfa-4819-831d-a614d5c7cb3c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:10.829879 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0202c0e5-1cfa-4819-831d-a614d5c7cb3c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:10.830645 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0202c0e5-1cfa-4819-831d-a614d5c7cb3c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:10.831039 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0202c0e5-1cfa-4819-831d-a614d5c7cb3c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:10.831463 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0202c0e5-1cfa-4819-831d-a614d5c7cb3c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:10.859951 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-eb70ad6d-502a-47ac-9bc3-7519ce3d326e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:10.867863 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-eb70ad6d-502a-47ac-9bc3-7519ce3d326e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb" status: 200 len: 1365 microversion: 2.1 time: 0.157110 Aug 05 20:11:10.868717 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 438/853] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:10 2022] GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:10.971822 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-0202c0e5-1cfa-4819-831d-a614d5c7cb3c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:10.981447 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-0202c0e5-1cfa-4819-831d-a614d5c7cb3c tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1567 microversion: 2.1 time: 0.166689 Aug 05 20:11:10.982046 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 416/854] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:10 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:11.890157 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-5056863a-5ff5-45c7-b396-7bffd15ecb45 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:11.890768 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-5056863a-5ff5-45c7-b396-7bffd15ecb45 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:11.897217 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5056863a-5ff5-45c7-b396-7bffd15ecb45 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:11.897704 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5056863a-5ff5-45c7-b396-7bffd15ecb45 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:11.898135 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5056863a-5ff5-45c7-b396-7bffd15ecb45 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:11.898821 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5056863a-5ff5-45c7-b396-7bffd15ecb45 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:11.899316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5056863a-5ff5-45c7-b396-7bffd15ecb45 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:11.899871 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5056863a-5ff5-45c7-b396-7bffd15ecb45 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:12.004343 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-ba4c6c66-d981-45f2-bab9-bff199bd3875 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:12.005000 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-ba4c6c66-d981-45f2-bab9-bff199bd3875 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:12.012629 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ba4c6c66-d981-45f2-bab9-bff199bd3875 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:12.013125 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ba4c6c66-d981-45f2-bab9-bff199bd3875 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:12.013566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ba4c6c66-d981-45f2-bab9-bff199bd3875 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:12.014278 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ba4c6c66-d981-45f2-bab9-bff199bd3875 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:12.014737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ba4c6c66-d981-45f2-bab9-bff199bd3875 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:12.015167 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ba4c6c66-d981-45f2-bab9-bff199bd3875 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:12.041898 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-5056863a-5ff5-45c7-b396-7bffd15ecb45 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:12.049423 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-5056863a-5ff5-45c7-b396-7bffd15ecb45 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb" status: 200 len: 1556 microversion: 2.1 time: 0.163097 Aug 05 20:11:12.049992 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 439/855] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:11 2022] GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:12.053611 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:11:12.054033 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Fri Aug 5 20:11:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 (ip 10.222.0.39) !!! Aug 05 20:11:12.072616 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-83887552-ad17-4f32-b062-fe3c95629a31 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:12.073172 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-83887552-ad17-4f32-b062-fe3c95629a31 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:12.079077 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-83887552-ad17-4f32-b062-fe3c95629a31 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:12.079557 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-83887552-ad17-4f32-b062-fe3c95629a31 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:12.079988 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-83887552-ad17-4f32-b062-fe3c95629a31 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:12.080708 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-83887552-ad17-4f32-b062-fe3c95629a31 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:12.081161 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-83887552-ad17-4f32-b062-fe3c95629a31 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:12.081579 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-83887552-ad17-4f32-b062-fe3c95629a31 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:12.186225 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-83887552-ad17-4f32-b062-fe3c95629a31 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.118467 Aug 05 20:11:12.186897 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 440/856] 10.222.0.39 () {58 vars in 1275 bytes} [Fri Aug 5 20:11:12 2022] GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:12.190687 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-ba4c6c66-d981-45f2-bab9-bff199bd3875 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:12.199801 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-ba4c6c66-d981-45f2-bab9-bff199bd3875 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1567 microversion: 2.1 time: 0.199584 Aug 05 20:11:12.200394 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 417/857] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:11 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1567 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:13.129380 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-234cf9bf-3f7d-4e48-bad3-37e4d07fa192 req-67e7a621-0f32-474c-8a0a-95f0b588dab1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4539af4-0b20-4505-801a-6adb0b19cddb", "tag": "d953e10e-e397-4f7c-b322-32c965ba3c7a"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:13.140070 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-234cf9bf-3f7d-4e48-bad3-37e4d07fa192 req-67e7a621-0f32-474c-8a0a-95f0b588dab1 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:13.140861 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-234cf9bf-3f7d-4e48-bad3-37e4d07fa192 req-67e7a621-0f32-474c-8a0a-95f0b588dab1 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:13.141290 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-234cf9bf-3f7d-4e48-bad3-37e4d07fa192 req-67e7a621-0f32-474c-8a0a-95f0b588dab1 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:13.153757 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-234cf9bf-3f7d-4e48-bad3-37e4d07fa192 req-67e7a621-0f32-474c-8a0a-95f0b588dab1 service nova] Creating event network-changed:d953e10e-e397-4f7c-b322-32c965ba3c7a for instance f4539af4-0b20-4505-801a-6adb0b19cddb on hv-cinder-85221 Aug 05 20:11:13.158948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-234cf9bf-3f7d-4e48-bad3-37e4d07fa192 req-67e7a621-0f32-474c-8a0a-95f0b588dab1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033081 Aug 05 20:11:13.159541 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 441/858] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:13.223496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9dd153ce-3349-40b8-9a2a-ddf09e699f0d tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:13.224217 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-9dd153ce-3349-40b8-9a2a-ddf09e699f0d tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:13.232163 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9dd153ce-3349-40b8-9a2a-ddf09e699f0d tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:13.232681 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9dd153ce-3349-40b8-9a2a-ddf09e699f0d tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:13.233117 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9dd153ce-3349-40b8-9a2a-ddf09e699f0d tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:13.233815 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9dd153ce-3349-40b8-9a2a-ddf09e699f0d tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:13.234265 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9dd153ce-3349-40b8-9a2a-ddf09e699f0d tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:13.234687 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9dd153ce-3349-40b8-9a2a-ddf09e699f0d tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:13.458402 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9dd153ce-3349-40b8-9a2a-ddf09e699f0d tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:13.475247 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-9dd153ce-3349-40b8-9a2a-ddf09e699f0d tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1567 microversion: 2.1 time: 0.247287 Aug 05 20:11:13.475894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 418/859] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:13 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1567 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:14.496637 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-0a335d75-2bbe-4d6a-817b-d815249f0725 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:14.497328 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-0a335d75-2bbe-4d6a-817b-d815249f0725 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:14.503465 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0a335d75-2bbe-4d6a-817b-d815249f0725 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:14.503940 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0a335d75-2bbe-4d6a-817b-d815249f0725 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:14.504373 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0a335d75-2bbe-4d6a-817b-d815249f0725 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:14.505082 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0a335d75-2bbe-4d6a-817b-d815249f0725 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:14.505534 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0a335d75-2bbe-4d6a-817b-d815249f0725 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:14.505959 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0a335d75-2bbe-4d6a-817b-d815249f0725 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:14.640824 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-0a335d75-2bbe-4d6a-817b-d815249f0725 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:14.648295 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-0a335d75-2bbe-4d6a-817b-d815249f0725 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1508 microversion: 2.1 time: 0.156658 Aug 05 20:11:14.648894 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 442/860] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:14 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:14.669207 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-5d673967-7e0c-44a7-a41d-af104cb689e1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:14.669837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-5d673967-7e0c-44a7-a41d-af104cb689e1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:14.675880 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5d673967-7e0c-44a7-a41d-af104cb689e1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:14.676365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5d673967-7e0c-44a7-a41d-af104cb689e1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:14.676835 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5d673967-7e0c-44a7-a41d-af104cb689e1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:14.677524 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5d673967-7e0c-44a7-a41d-af104cb689e1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:14.677975 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5d673967-7e0c-44a7-a41d-af104cb689e1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:14.678408 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5d673967-7e0c-44a7-a41d-af104cb689e1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:14.719942 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-5d673967-7e0c-44a7-a41d-af104cb689e1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118191) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 20:11:14.785407 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-5d673967-7e0c-44a7-a41d-af104cb689e1 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "POST /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54/action" status: 202 len: 0 microversion: 2.1 time: 0.120451 Aug 05 20:11:14.786009 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 419/861] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Aug 5 20:11:14 2022] POST /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:11:14.794721 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-3c413e44-5b08-41cb-9eac-a1176eece864 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:14.795326 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-3c413e44-5b08-41cb-9eac-a1176eece864 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:14.801750 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3c413e44-5b08-41cb-9eac-a1176eece864 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:14.802236 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3c413e44-5b08-41cb-9eac-a1176eece864 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:14.802858 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3c413e44-5b08-41cb-9eac-a1176eece864 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:14.803558 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3c413e44-5b08-41cb-9eac-a1176eece864 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:14.804007 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3c413e44-5b08-41cb-9eac-a1176eece864 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:14.804432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3c413e44-5b08-41cb-9eac-a1176eece864 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:14.940936 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-3c413e44-5b08-41cb-9eac-a1176eece864 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:14.949286 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-3c413e44-5b08-41cb-9eac-a1176eece864 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1516 microversion: 2.1 time: 0.158808 Aug 05 20:11:14.954122 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 443/862] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:14 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:15.971662 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-b9b8453d-a2f0-42a2-8e85-830a726f95a2 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:15.972274 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-b9b8453d-a2f0-42a2-8e85-830a726f95a2 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:15.978909 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b9b8453d-a2f0-42a2-8e85-830a726f95a2 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:15.979398 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b9b8453d-a2f0-42a2-8e85-830a726f95a2 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:15.979831 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b9b8453d-a2f0-42a2-8e85-830a726f95a2 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:15.980518 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b9b8453d-a2f0-42a2-8e85-830a726f95a2 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:15.980994 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b9b8453d-a2f0-42a2-8e85-830a726f95a2 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:15.981415 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b9b8453d-a2f0-42a2-8e85-830a726f95a2 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:16.034678 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-00f3576c-266c-4091-bd25-e91cbb071338 req-5099f9e5-b14d-4b5c-ba49-e7ea75c6fb24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5559da3c-05e6-432d-960c-67c53284cc54", "name": "network-vif-unplugged", "status": "completed", "tag": "5e5897da-174c-4054-8f66-ed7648322749"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:16.047011 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-00f3576c-266c-4091-bd25-e91cbb071338 req-5099f9e5-b14d-4b5c-ba49-e7ea75c6fb24 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:16.047504 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-00f3576c-266c-4091-bd25-e91cbb071338 req-5099f9e5-b14d-4b5c-ba49-e7ea75c6fb24 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:16.048119 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-00f3576c-266c-4091-bd25-e91cbb071338 req-5099f9e5-b14d-4b5c-ba49-e7ea75c6fb24 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:16.062312 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.compute.server_external_events [req-00f3576c-266c-4091-bd25-e91cbb071338 req-5099f9e5-b14d-4b5c-ba49-e7ea75c6fb24 service nova] Unable to find a host for instance 5559da3c-05e6-432d-960c-67c53284cc54. Dropping event network-vif-unplugged {{(pid=118192) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 05 20:11:16.063619 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-00f3576c-266c-4091-bd25-e91cbb071338 req-5099f9e5-b14d-4b5c-ba49-e7ea75c6fb24 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032936 Aug 05 20:11:16.064429 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 444/863] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 05 20:11:16.127449 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-b9b8453d-a2f0-42a2-8e85-830a726f95a2 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:16.135688 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-b9b8453d-a2f0-42a2-8e85-830a726f95a2 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1518 microversion: 2.1 time: 0.168462 Aug 05 20:11:16.136263 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 420/864] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:15 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:17.157546 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-c98135b1-6c3d-491b-a9b6-2c4afc9483dd tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:17.158153 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-c98135b1-6c3d-491b-a9b6-2c4afc9483dd tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:17.164518 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c98135b1-6c3d-491b-a9b6-2c4afc9483dd tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:17.165030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c98135b1-6c3d-491b-a9b6-2c4afc9483dd tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:17.165462 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c98135b1-6c3d-491b-a9b6-2c4afc9483dd tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:17.166141 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c98135b1-6c3d-491b-a9b6-2c4afc9483dd tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:17.166865 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c98135b1-6c3d-491b-a9b6-2c4afc9483dd tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:17.167251 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c98135b1-6c3d-491b-a9b6-2c4afc9483dd tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:17.390191 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-c98135b1-6c3d-491b-a9b6-2c4afc9483dd tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:17.397769 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-c98135b1-6c3d-491b-a9b6-2c4afc9483dd tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1574 microversion: 2.1 time: 0.244113 Aug 05 20:11:17.398599 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 445/865] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:17 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1574 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:18.428049 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-21694fd4-3f96-4d99-b65a-a15ae9a2aac7 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:18.428618 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-21694fd4-3f96-4d99-b65a-a15ae9a2aac7 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:18.436002 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-21694fd4-3f96-4d99-b65a-a15ae9a2aac7 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:18.436496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-21694fd4-3f96-4d99-b65a-a15ae9a2aac7 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:18.436961 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-21694fd4-3f96-4d99-b65a-a15ae9a2aac7 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:18.437657 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-21694fd4-3f96-4d99-b65a-a15ae9a2aac7 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:18.438115 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-21694fd4-3f96-4d99-b65a-a15ae9a2aac7 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:18.438544 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-21694fd4-3f96-4d99-b65a-a15ae9a2aac7 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:18.576386 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-21694fd4-3f96-4d99-b65a-a15ae9a2aac7 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:18.584024 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-21694fd4-3f96-4d99-b65a-a15ae9a2aac7 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1574 microversion: 2.1 time: 0.159904 Aug 05 20:11:18.584613 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 421/866] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:18 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:19.606431 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-488e5430-0b13-45b3-8946-7dedce5df1cf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:19.607093 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-488e5430-0b13-45b3-8946-7dedce5df1cf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:19.614204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-488e5430-0b13-45b3-8946-7dedce5df1cf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:19.614706 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-488e5430-0b13-45b3-8946-7dedce5df1cf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:19.615151 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-488e5430-0b13-45b3-8946-7dedce5df1cf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:19.615864 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-488e5430-0b13-45b3-8946-7dedce5df1cf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:19.616322 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-488e5430-0b13-45b3-8946-7dedce5df1cf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:19.616785 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-488e5430-0b13-45b3-8946-7dedce5df1cf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:19.796091 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-488e5430-0b13-45b3-8946-7dedce5df1cf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:19.804788 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-488e5430-0b13-45b3-8946-7dedce5df1cf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1574 microversion: 2.1 time: 0.203158 Aug 05 20:11:19.805367 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 446/867] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:19 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1574 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:20.828034 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-c6e2f725-d8b4-41f3-8db0-bf98d2b5f501 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:20.828661 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-c6e2f725-d8b4-41f3-8db0-bf98d2b5f501 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:20.835198 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c6e2f725-d8b4-41f3-8db0-bf98d2b5f501 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:20.835682 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c6e2f725-d8b4-41f3-8db0-bf98d2b5f501 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:20.836114 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c6e2f725-d8b4-41f3-8db0-bf98d2b5f501 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:20.836840 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c6e2f725-d8b4-41f3-8db0-bf98d2b5f501 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:20.837293 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c6e2f725-d8b4-41f3-8db0-bf98d2b5f501 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:20.837710 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c6e2f725-d8b4-41f3-8db0-bf98d2b5f501 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:20.986204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-c6e2f725-d8b4-41f3-8db0-bf98d2b5f501 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:20.994488 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-c6e2f725-d8b4-41f3-8db0-bf98d2b5f501 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1574 microversion: 2.1 time: 0.170519 Aug 05 20:11:20.995135 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 422/868] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:20 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:22.078238 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a3eaeac9-a310-4434-86d8-9a497cdc14f0 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:22.078829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a3eaeac9-a310-4434-86d8-9a497cdc14f0 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:22.085182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a3eaeac9-a310-4434-86d8-9a497cdc14f0 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:22.085663 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a3eaeac9-a310-4434-86d8-9a497cdc14f0 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:22.086095 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a3eaeac9-a310-4434-86d8-9a497cdc14f0 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:22.086782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a3eaeac9-a310-4434-86d8-9a497cdc14f0 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:22.087228 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a3eaeac9-a310-4434-86d8-9a497cdc14f0 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:22.087650 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a3eaeac9-a310-4434-86d8-9a497cdc14f0 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:22.217753 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a3eaeac9-a310-4434-86d8-9a497cdc14f0 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:22.225202 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a3eaeac9-a310-4434-86d8-9a497cdc14f0 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1574 microversion: 2.1 time: 0.150933 Aug 05 20:11:22.225761 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 447/869] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:22 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:23.246994 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f72d0947-25cd-458d-8cd4-cddf3702b306 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:23.247607 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f72d0947-25cd-458d-8cd4-cddf3702b306 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:23.254122 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f72d0947-25cd-458d-8cd4-cddf3702b306 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:23.254601 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f72d0947-25cd-458d-8cd4-cddf3702b306 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:23.255037 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f72d0947-25cd-458d-8cd4-cddf3702b306 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:23.255729 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f72d0947-25cd-458d-8cd4-cddf3702b306 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:23.256177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f72d0947-25cd-458d-8cd4-cddf3702b306 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:23.256610 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f72d0947-25cd-458d-8cd4-cddf3702b306 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:23.392722 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f72d0947-25cd-458d-8cd4-cddf3702b306 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:23.394927 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:23.401625 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f72d0947-25cd-458d-8cd4-cddf3702b306 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1574 microversion: 2.1 time: 0.158561 Aug 05 20:11:23.402830 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 423/870] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:23 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:24.423240 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-69678a50-ef39-4277-a5c9-a08e932df971 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:24.423812 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-69678a50-ef39-4277-a5c9-a08e932df971 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:24.429779 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-69678a50-ef39-4277-a5c9-a08e932df971 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:24.430272 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-69678a50-ef39-4277-a5c9-a08e932df971 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:24.430713 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-69678a50-ef39-4277-a5c9-a08e932df971 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:24.431419 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-69678a50-ef39-4277-a5c9-a08e932df971 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:24.431910 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-69678a50-ef39-4277-a5c9-a08e932df971 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:24.432342 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-69678a50-ef39-4277-a5c9-a08e932df971 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:24.435547 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=100 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:24.577911 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-69678a50-ef39-4277-a5c9-a08e932df971 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:24.585399 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-69678a50-ef39-4277-a5c9-a08e932df971 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1574 microversion: 2.1 time: 0.166322 Aug 05 20:11:24.585961 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 448/871] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:24 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:25.607215 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7593ea98-de36-49fd-a8cd-5835c61099ba tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:25.607819 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-7593ea98-de36-49fd-a8cd-5835c61099ba tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:25.615644 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7593ea98-de36-49fd-a8cd-5835c61099ba tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:25.616228 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7593ea98-de36-49fd-a8cd-5835c61099ba tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:25.616705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7593ea98-de36-49fd-a8cd-5835c61099ba tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:25.617417 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7593ea98-de36-49fd-a8cd-5835c61099ba tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:25.617877 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7593ea98-de36-49fd-a8cd-5835c61099ba tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:25.618308 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7593ea98-de36-49fd-a8cd-5835c61099ba tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:25.762400 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-7593ea98-de36-49fd-a8cd-5835c61099ba tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:25.770163 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-7593ea98-de36-49fd-a8cd-5835c61099ba tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1574 microversion: 2.1 time: 0.167654 Aug 05 20:11:25.770745 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 424/872] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:25 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:26.791256 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-042225ba-db3d-48cc-b200-bc6ffefdcc4b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:26.791806 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-042225ba-db3d-48cc-b200-bc6ffefdcc4b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:26.798835 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-042225ba-db3d-48cc-b200-bc6ffefdcc4b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:26.799322 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-042225ba-db3d-48cc-b200-bc6ffefdcc4b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:26.799758 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-042225ba-db3d-48cc-b200-bc6ffefdcc4b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:26.800454 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-042225ba-db3d-48cc-b200-bc6ffefdcc4b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:26.800936 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-042225ba-db3d-48cc-b200-bc6ffefdcc4b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:26.801388 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-042225ba-db3d-48cc-b200-bc6ffefdcc4b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:26.931665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-042225ba-db3d-48cc-b200-bc6ffefdcc4b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:26.939867 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-042225ba-db3d-48cc-b200-bc6ffefdcc4b tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1574 microversion: 2.1 time: 0.152601 Aug 05 20:11:26.940436 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 449/873] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:26 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:27.962114 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3b2c2c97-6460-481b-a54b-7a576ea0aafd tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:27.962768 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-3b2c2c97-6460-481b-a54b-7a576ea0aafd tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:27.971026 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3b2c2c97-6460-481b-a54b-7a576ea0aafd tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:27.971524 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3b2c2c97-6460-481b-a54b-7a576ea0aafd tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:27.971961 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3b2c2c97-6460-481b-a54b-7a576ea0aafd tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:27.972701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3b2c2c97-6460-481b-a54b-7a576ea0aafd tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:27.973165 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3b2c2c97-6460-481b-a54b-7a576ea0aafd tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:27.973596 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3b2c2c97-6460-481b-a54b-7a576ea0aafd tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:28.122472 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3b2c2c97-6460-481b-a54b-7a576ea0aafd tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:28.130871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3b2c2c97-6460-481b-a54b-7a576ea0aafd tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1574 microversion: 2.1 time: 0.172520 Aug 05 20:11:28.131470 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 425/874] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:27 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:29.155625 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a1a070b2-76be-41da-ba91-daab9b748f87 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:29.156276 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a1a070b2-76be-41da-ba91-daab9b748f87 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:29.162641 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a1a070b2-76be-41da-ba91-daab9b748f87 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:29.163139 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a1a070b2-76be-41da-ba91-daab9b748f87 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:29.163582 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a1a070b2-76be-41da-ba91-daab9b748f87 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:29.164276 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a1a070b2-76be-41da-ba91-daab9b748f87 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:29.164771 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a1a070b2-76be-41da-ba91-daab9b748f87 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:29.165207 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a1a070b2-76be-41da-ba91-daab9b748f87 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:29.191048 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-6ede6d48-8e99-4710-abf9-8d91879497f5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:29.191659 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-6ede6d48-8e99-4710-abf9-8d91879497f5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:29.199131 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6ede6d48-8e99-4710-abf9-8d91879497f5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:29.200275 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6ede6d48-8e99-4710-abf9-8d91879497f5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:29.201372 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6ede6d48-8e99-4710-abf9-8d91879497f5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:29.202315 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6ede6d48-8e99-4710-abf9-8d91879497f5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:29.202866 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6ede6d48-8e99-4710-abf9-8d91879497f5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:29.203360 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6ede6d48-8e99-4710-abf9-8d91879497f5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:29.238354 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-6ede6d48-8e99-4710-abf9-8d91879497f5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb/os-volume_attachments/f0a2e094-8931-4e8a-b410-c64f2e9ce6e8" status: 200 len: 194 microversion: 2.20 time: 0.051239 Aug 05 20:11:29.238972 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 426/875] 10.222.0.39 () {60 vars in 1454 bytes} [Fri Aug 5 20:11:29 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb/os-volume_attachments/f0a2e094-8931-4e8a-b410-c64f2e9ce6e8 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 20:11:29.311450 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-12ceabf6-86a5-487b-85f3-d4207bdcff3c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:29.311947 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-12ceabf6-86a5-487b-85f3-d4207bdcff3c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:29.317412 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a1a070b2-76be-41da-ba91-daab9b748f87 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:29.318061 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-12ceabf6-86a5-487b-85f3-d4207bdcff3c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:29.318545 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-12ceabf6-86a5-487b-85f3-d4207bdcff3c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:29.318978 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-12ceabf6-86a5-487b-85f3-d4207bdcff3c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:29.319675 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-12ceabf6-86a5-487b-85f3-d4207bdcff3c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:29.320126 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-12ceabf6-86a5-487b-85f3-d4207bdcff3c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:29.320549 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-12ceabf6-86a5-487b-85f3-d4207bdcff3c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:29.325155 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a1a070b2-76be-41da-ba91-daab9b748f87 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1574 microversion: 2.1 time: 0.173461 Aug 05 20:11:29.325739 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 450/876] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:29 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:29.406741 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.objects.instance [None req-12ceabf6-86a5-487b-85f3-d4207bdcff3c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lazy-loading 'services' on Instance uuid 98e6fc07-61b1-455d-8bf0-563c5debbebb {{(pid=118191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:11:29.491112 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-12ceabf6-86a5-487b-85f3-d4207bdcff3c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "DELETE /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb/os-volume_attachments/f0a2e094-8931-4e8a-b410-c64f2e9ce6e8" status: 202 len: 0 microversion: 2.20 time: 0.184055 Aug 05 20:11:29.491816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 427/877] 10.222.0.39 () {60 vars in 1457 bytes} [Fri Aug 5 20:11:29 2022] DELETE /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb/os-volume_attachments/f0a2e094-8931-4e8a-b410-c64f2e9ce6e8 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 05 20:11:29.503089 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a394eba7-83f2-441e-b6eb-e1d4e940c686 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:29.505184 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a394eba7-83f2-441e-b6eb-e1d4e940c686 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:29.513232 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a394eba7-83f2-441e-b6eb-e1d4e940c686 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:29.513870 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a394eba7-83f2-441e-b6eb-e1d4e940c686 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:29.514311 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a394eba7-83f2-441e-b6eb-e1d4e940c686 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:29.515053 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a394eba7-83f2-441e-b6eb-e1d4e940c686 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:29.515643 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a394eba7-83f2-441e-b6eb-e1d4e940c686 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:29.516080 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a394eba7-83f2-441e-b6eb-e1d4e940c686 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:29.550250 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a394eba7-83f2-441e-b6eb-e1d4e940c686 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053442 Aug 05 20:11:29.551016 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 451/878] 10.222.0.39 () {60 vars in 1343 bytes} [Fri Aug 5 20:11:29 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:11:30.351982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f4b9bbeb-2f72-4ab0-8071-35f450585f35 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:30.352870 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f4b9bbeb-2f72-4ab0-8071-35f450585f35 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:30.359946 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f4b9bbeb-2f72-4ab0-8071-35f450585f35 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:30.360731 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f4b9bbeb-2f72-4ab0-8071-35f450585f35 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:30.361344 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f4b9bbeb-2f72-4ab0-8071-35f450585f35 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:30.362233 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f4b9bbeb-2f72-4ab0-8071-35f450585f35 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:30.362850 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f4b9bbeb-2f72-4ab0-8071-35f450585f35 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:30.363438 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f4b9bbeb-2f72-4ab0-8071-35f450585f35 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:30.521700 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f4b9bbeb-2f72-4ab0-8071-35f450585f35 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:30.531977 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f4b9bbeb-2f72-4ab0-8071-35f450585f35 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1574 microversion: 2.1 time: 0.184432 Aug 05 20:11:30.532812 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 428/879] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:30 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1574 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:30.567396 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-35dbfbd8-09b0-440d-a4f9-fbdd2a22ab6d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:30.569574 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-35dbfbd8-09b0-440d-a4f9-fbdd2a22ab6d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:30.577218 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-35dbfbd8-09b0-440d-a4f9-fbdd2a22ab6d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:30.577704 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-35dbfbd8-09b0-440d-a4f9-fbdd2a22ab6d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:30.578129 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-35dbfbd8-09b0-440d-a4f9-fbdd2a22ab6d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:30.578878 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-35dbfbd8-09b0-440d-a4f9-fbdd2a22ab6d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:30.579416 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-35dbfbd8-09b0-440d-a4f9-fbdd2a22ab6d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:30.579865 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-35dbfbd8-09b0-440d-a4f9-fbdd2a22ab6d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:30.611767 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-35dbfbd8-09b0-440d-a4f9-fbdd2a22ab6d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050575 Aug 05 20:11:30.612449 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 452/880] 10.222.0.39 () {60 vars in 1343 bytes} [Fri Aug 5 20:11:30 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 20:11:30.847498 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-4b129e5c-4ad8-4920-aef1-40bcbc4f7c72 req-ed791529-e7fa-4c9e-8a26-bc9c25b4c853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5559da3c-05e6-432d-960c-67c53284cc54", "name": "network-vif-plugged", "status": "completed", "tag": "5e5897da-174c-4054-8f66-ed7648322749"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:30.858230 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-4b129e5c-4ad8-4920-aef1-40bcbc4f7c72 req-ed791529-e7fa-4c9e-8a26-bc9c25b4c853 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:30.858896 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-4b129e5c-4ad8-4920-aef1-40bcbc4f7c72 req-ed791529-e7fa-4c9e-8a26-bc9c25b4c853 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:30.859518 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-4b129e5c-4ad8-4920-aef1-40bcbc4f7c72 req-ed791529-e7fa-4c9e-8a26-bc9c25b4c853 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:30.872984 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-4b129e5c-4ad8-4920-aef1-40bcbc4f7c72 req-ed791529-e7fa-4c9e-8a26-bc9c25b4c853 service nova] Creating event network-vif-plugged:5e5897da-174c-4054-8f66-ed7648322749 for instance 5559da3c-05e6-432d-960c-67c53284cc54 on hv-cinder-85221 Aug 05 20:11:30.878025 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-4b129e5c-4ad8-4920-aef1-40bcbc4f7c72 req-ed791529-e7fa-4c9e-8a26-bc9c25b4c853 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034315 Aug 05 20:11:30.878652 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 429/881] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:31.554327 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-595c8eb7-dce9-4d5e-b1d3-599b3f9483f5 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:31.554871 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-595c8eb7-dce9-4d5e-b1d3-599b3f9483f5 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:31.560993 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-595c8eb7-dce9-4d5e-b1d3-599b3f9483f5 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:31.561488 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-595c8eb7-dce9-4d5e-b1d3-599b3f9483f5 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:31.561926 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-595c8eb7-dce9-4d5e-b1d3-599b3f9483f5 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:31.562633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-595c8eb7-dce9-4d5e-b1d3-599b3f9483f5 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:31.563090 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-595c8eb7-dce9-4d5e-b1d3-599b3f9483f5 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:31.563519 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-595c8eb7-dce9-4d5e-b1d3-599b3f9483f5 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:31.624945 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-8c01c346-e085-4bc6-ae92-8ada882f562b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:31.627729 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-8c01c346-e085-4bc6-ae92-8ada882f562b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:31.634114 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8c01c346-e085-4bc6-ae92-8ada882f562b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:31.634865 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8c01c346-e085-4bc6-ae92-8ada882f562b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:31.635300 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8c01c346-e085-4bc6-ae92-8ada882f562b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:31.636027 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8c01c346-e085-4bc6-ae92-8ada882f562b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:31.636475 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8c01c346-e085-4bc6-ae92-8ada882f562b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:31.637614 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8c01c346-e085-4bc6-ae92-8ada882f562b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:31.667727 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-8c01c346-e085-4bc6-ae92-8ada882f562b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047838 Aug 05 20:11:31.669412 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 430/882] 10.222.0.39 () {60 vars in 1343 bytes} [Fri Aug 5 20:11:31 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:31.699990 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-595c8eb7-dce9-4d5e-b1d3-599b3f9483f5 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:31.707492 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-595c8eb7-dce9-4d5e-b1d3-599b3f9483f5 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1574 microversion: 2.1 time: 0.157352 Aug 05 20:11:31.708294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 453/883] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:31 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:31.736834 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-b3681d3e-bdca-443a-aef2-531453111f70 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:31.737408 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-b3681d3e-bdca-443a-aef2-531453111f70 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:31.743335 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b3681d3e-bdca-443a-aef2-531453111f70 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:31.743814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b3681d3e-bdca-443a-aef2-531453111f70 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:31.744246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b3681d3e-bdca-443a-aef2-531453111f70 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:31.745021 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b3681d3e-bdca-443a-aef2-531453111f70 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:31.745473 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b3681d3e-bdca-443a-aef2-531453111f70 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:31.745895 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b3681d3e-bdca-443a-aef2-531453111f70 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:31.771108 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-b3681d3e-bdca-443a-aef2-531453111f70 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Going to try to terminate instance {{(pid=118191) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:11:31.844088 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-b3681d3e-bdca-443a-aef2-531453111f70 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "DELETE /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 204 len: 0 microversion: 2.20 time: 0.110908 Aug 05 20:11:31.844609 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 431/884] 10.222.0.39 () {60 vars in 1280 bytes} [Fri Aug 5 20:11:31 2022] DELETE /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 20:11:31.852761 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-6aa0f375-152c-4ee4-93ed-99041e6d8374 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:31.853380 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-6aa0f375-152c-4ee4-93ed-99041e6d8374 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:31.859898 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6aa0f375-152c-4ee4-93ed-99041e6d8374 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:31.860417 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6aa0f375-152c-4ee4-93ed-99041e6d8374 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:31.860900 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6aa0f375-152c-4ee4-93ed-99041e6d8374 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:31.861600 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6aa0f375-152c-4ee4-93ed-99041e6d8374 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:31.862058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6aa0f375-152c-4ee4-93ed-99041e6d8374 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:31.862488 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6aa0f375-152c-4ee4-93ed-99041e6d8374 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:32.233484 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-6aa0f375-152c-4ee4-93ed-99041e6d8374 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:32.241317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-6aa0f375-152c-4ee4-93ed-99041e6d8374 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:32.242829 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-6aa0f375-152c-4ee4-93ed-99041e6d8374 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:32.243984 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-6aa0f375-152c-4ee4-93ed-99041e6d8374 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1724 microversion: 2.20 time: 0.395111 Aug 05 20:11:32.244542 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 454/885] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:31 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1724 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:32.729383 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e9bf6733-0324-4cfb-ad64-b97e159829aa tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:32.730087 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e9bf6733-0324-4cfb-ad64-b97e159829aa tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:32.737678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e9bf6733-0324-4cfb-ad64-b97e159829aa tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:32.738159 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e9bf6733-0324-4cfb-ad64-b97e159829aa tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:32.738606 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e9bf6733-0324-4cfb-ad64-b97e159829aa tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:32.739300 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e9bf6733-0324-4cfb-ad64-b97e159829aa tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:32.739757 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e9bf6733-0324-4cfb-ad64-b97e159829aa tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:32.740180 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e9bf6733-0324-4cfb-ad64-b97e159829aa tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:32.870596 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e9bf6733-0324-4cfb-ad64-b97e159829aa tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:32.879218 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e9bf6733-0324-4cfb-ad64-b97e159829aa tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1574 microversion: 2.1 time: 0.154059 Aug 05 20:11:32.879786 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 432/886] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:32 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:33.267844 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-fca70983-2587-48c8-abc0-c973181e090f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:33.269154 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-fca70983-2587-48c8-abc0-c973181e090f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:33.276543 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fca70983-2587-48c8-abc0-c973181e090f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:33.278375 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fca70983-2587-48c8-abc0-c973181e090f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:33.278671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fca70983-2587-48c8-abc0-c973181e090f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:33.279468 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fca70983-2587-48c8-abc0-c973181e090f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:33.279934 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fca70983-2587-48c8-abc0-c973181e090f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:33.280366 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fca70983-2587-48c8-abc0-c973181e090f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:33.411628 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-fca70983-2587-48c8-abc0-c973181e090f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:33.420245 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-fca70983-2587-48c8-abc0-c973181e090f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:33.421800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-fca70983-2587-48c8-abc0-c973181e090f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:33.422960 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-fca70983-2587-48c8-abc0-c973181e090f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1724 microversion: 2.20 time: 0.159014 Aug 05 20:11:33.423527 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 455/887] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:33 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:33.900947 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-0d0a91da-caa8-457d-8089-3bb029077b0e tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:33.901567 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-0d0a91da-caa8-457d-8089-3bb029077b0e tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:33.908651 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0d0a91da-caa8-457d-8089-3bb029077b0e tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:33.909141 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0d0a91da-caa8-457d-8089-3bb029077b0e tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:33.909571 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0d0a91da-caa8-457d-8089-3bb029077b0e tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:33.910258 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0d0a91da-caa8-457d-8089-3bb029077b0e tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:33.910708 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0d0a91da-caa8-457d-8089-3bb029077b0e tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:33.911129 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0d0a91da-caa8-457d-8089-3bb029077b0e tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:34.037927 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-002c8364-4f63-46c9-b550-e55151e55e78 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:34.038720 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-002c8364-4f63-46c9-b550-e55151e55e78 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:34.046277 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-002c8364-4f63-46c9-b550-e55151e55e78 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:34.046806 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-002c8364-4f63-46c9-b550-e55151e55e78 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:34.047249 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-002c8364-4f63-46c9-b550-e55151e55e78 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:34.047966 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-002c8364-4f63-46c9-b550-e55151e55e78 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:34.048442 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-002c8364-4f63-46c9-b550-e55151e55e78 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:34.048915 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-002c8364-4f63-46c9-b550-e55151e55e78 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:34.052683 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-0d0a91da-caa8-457d-8089-3bb029077b0e tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:34.061466 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-0d0a91da-caa8-457d-8089-3bb029077b0e tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1574 microversion: 2.1 time: 0.164305 Aug 05 20:11:34.062061 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 433/888] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:33 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:34.131274 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.objects.instance [None req-002c8364-4f63-46c9-b550-e55151e55e78 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lazy-loading 'services' on Instance uuid 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 {{(pid=118192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:11:34.203773 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-002c8364-4f63-46c9-b550-e55151e55e78 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "DELETE /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1/os-volume_attachments/0efc580c-295e-4061-aedc-195f049f7f1e" status: 202 len: 0 microversion: 2.1 time: 0.169734 Aug 05 20:11:34.204351 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 456/889] 10.222.0.39 () {58 vars in 1416 bytes} [Fri Aug 5 20:11:34 2022] DELETE /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1/os-volume_attachments/0efc580c-295e-4061-aedc-195f049f7f1e => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 20:11:34.212854 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-74a195d2-94c4-4e50-9039-4dc2239b8f05 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:34.215598 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-74a195d2-94c4-4e50-9039-4dc2239b8f05 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:34.221609 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-74a195d2-94c4-4e50-9039-4dc2239b8f05 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:34.222096 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-74a195d2-94c4-4e50-9039-4dc2239b8f05 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:34.222527 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-74a195d2-94c4-4e50-9039-4dc2239b8f05 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:34.223217 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-74a195d2-94c4-4e50-9039-4dc2239b8f05 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:34.223669 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-74a195d2-94c4-4e50-9039-4dc2239b8f05 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:34.224093 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-74a195d2-94c4-4e50-9039-4dc2239b8f05 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:34.254308 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-74a195d2-94c4-4e50-9039-4dc2239b8f05 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045519 Aug 05 20:11:34.254867 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 434/890] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Aug 5 20:11:34 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:34.446540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-520628d7-1353-4c79-a5a0-41e5aafaa72f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:34.447172 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-520628d7-1353-4c79-a5a0-41e5aafaa72f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:34.454028 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-520628d7-1353-4c79-a5a0-41e5aafaa72f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:34.454506 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-520628d7-1353-4c79-a5a0-41e5aafaa72f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:34.454933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-520628d7-1353-4c79-a5a0-41e5aafaa72f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:34.455618 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-520628d7-1353-4c79-a5a0-41e5aafaa72f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:34.456065 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-520628d7-1353-4c79-a5a0-41e5aafaa72f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:34.456481 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-520628d7-1353-4c79-a5a0-41e5aafaa72f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:34.588200 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-520628d7-1353-4c79-a5a0-41e5aafaa72f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:34.597255 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-520628d7-1353-4c79-a5a0-41e5aafaa72f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:34.598762 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-520628d7-1353-4c79-a5a0-41e5aafaa72f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:34.599924 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-520628d7-1353-4c79-a5a0-41e5aafaa72f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1724 microversion: 2.20 time: 0.158200 Aug 05 20:11:34.600482 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 457/891] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:34 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:35.082597 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9c4c171e-3227-4a91-9fd4-863f3ba1a4da tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:35.083215 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-9c4c171e-3227-4a91-9fd4-863f3ba1a4da tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:35.089760 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9c4c171e-3227-4a91-9fd4-863f3ba1a4da tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:35.090492 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9c4c171e-3227-4a91-9fd4-863f3ba1a4da tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:35.090746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9c4c171e-3227-4a91-9fd4-863f3ba1a4da tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:35.091435 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9c4c171e-3227-4a91-9fd4-863f3ba1a4da tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:35.091920 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9c4c171e-3227-4a91-9fd4-863f3ba1a4da tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:35.092346 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9c4c171e-3227-4a91-9fd4-863f3ba1a4da tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:35.233064 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9c4c171e-3227-4a91-9fd4-863f3ba1a4da tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:35.240680 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-9c4c171e-3227-4a91-9fd4-863f3ba1a4da tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1561 microversion: 2.1 time: 0.162057 Aug 05 20:11:35.241245 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 435/892] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:35 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:35.267290 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a701ebf5-6c23-4b41-8fbe-98f75a2d91d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:35.269587 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a701ebf5-6c23-4b41-8fbe-98f75a2d91d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:35.271526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=50 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:35.277135 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a701ebf5-6c23-4b41-8fbe-98f75a2d91d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:35.277930 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a701ebf5-6c23-4b41-8fbe-98f75a2d91d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:35.278157 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a701ebf5-6c23-4b41-8fbe-98f75a2d91d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:35.278954 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a701ebf5-6c23-4b41-8fbe-98f75a2d91d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:35.279266 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a701ebf5-6c23-4b41-8fbe-98f75a2d91d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:35.279685 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a701ebf5-6c23-4b41-8fbe-98f75a2d91d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:35.309848 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a701ebf5-6c23-4b41-8fbe-98f75a2d91d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046444 Aug 05 20:11:35.310403 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 458/893] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Aug 5 20:11:35 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:11:35.624444 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-0085a9d5-1cdf-43ef-9beb-64d3d8ae6e94 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:35.625099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-0085a9d5-1cdf-43ef-9beb-64d3d8ae6e94 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:35.631127 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0085a9d5-1cdf-43ef-9beb-64d3d8ae6e94 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:35.631607 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0085a9d5-1cdf-43ef-9beb-64d3d8ae6e94 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:35.632040 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0085a9d5-1cdf-43ef-9beb-64d3d8ae6e94 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:35.632771 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0085a9d5-1cdf-43ef-9beb-64d3d8ae6e94 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:35.633210 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0085a9d5-1cdf-43ef-9beb-64d3d8ae6e94 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:35.633633 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0085a9d5-1cdf-43ef-9beb-64d3d8ae6e94 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:35.770112 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-0085a9d5-1cdf-43ef-9beb-64d3d8ae6e94 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:35.778591 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-0085a9d5-1cdf-43ef-9beb-64d3d8ae6e94 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:35.780099 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-0085a9d5-1cdf-43ef-9beb-64d3d8ae6e94 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:35.781290 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-0085a9d5-1cdf-43ef-9beb-64d3d8ae6e94 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1724 microversion: 2.20 time: 0.161728 Aug 05 20:11:35.781844 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 436/894] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:35 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:36.321538 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-997d8be2-3db6-4e38-a1b0-77fd392d6ec6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:36.323685 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-997d8be2-3db6-4e38-a1b0-77fd392d6ec6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:36.330921 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-997d8be2-3db6-4e38-a1b0-77fd392d6ec6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:36.331409 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-997d8be2-3db6-4e38-a1b0-77fd392d6ec6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:36.331843 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-997d8be2-3db6-4e38-a1b0-77fd392d6ec6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:36.332567 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-997d8be2-3db6-4e38-a1b0-77fd392d6ec6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:36.333067 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-997d8be2-3db6-4e38-a1b0-77fd392d6ec6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:36.333496 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-997d8be2-3db6-4e38-a1b0-77fd392d6ec6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:36.365834 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-997d8be2-3db6-4e38-a1b0-77fd392d6ec6 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048306 Aug 05 20:11:36.366428 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 459/895] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Aug 5 20:11:36 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:36.806347 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-6d040844-adf9-4489-a943-90db50b2f8cc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:36.806975 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-6d040844-adf9-4489-a943-90db50b2f8cc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:36.814100 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6d040844-adf9-4489-a943-90db50b2f8cc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:36.814610 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6d040844-adf9-4489-a943-90db50b2f8cc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:36.815158 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6d040844-adf9-4489-a943-90db50b2f8cc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:36.816047 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6d040844-adf9-4489-a943-90db50b2f8cc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:36.816502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6d040844-adf9-4489-a943-90db50b2f8cc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:36.816955 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6d040844-adf9-4489-a943-90db50b2f8cc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:37.058999 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-6d040844-adf9-4489-a943-90db50b2f8cc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:37.069681 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-6d040844-adf9-4489-a943-90db50b2f8cc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:37.071363 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-6d040844-adf9-4489-a943-90db50b2f8cc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:37.072675 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-6d040844-adf9-4489-a943-90db50b2f8cc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1724 microversion: 2.20 time: 0.270465 Aug 05 20:11:37.073754 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 437/896] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:36 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:37.355019 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-ab654b0b-ad81-44e3-8dee-cfbdcbd0bbde req-8762dc1d-2a89-4ffc-8f8a-cf062dbdca93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98e6fc07-61b1-455d-8bf0-563c5debbebb", "name": "network-vif-deleted", "tag": "e1afce7c-4bdd-432b-905f-443b0227fa80"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:37.365827 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-ab654b0b-ad81-44e3-8dee-cfbdcbd0bbde req-8762dc1d-2a89-4ffc-8f8a-cf062dbdca93 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:37.366520 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-ab654b0b-ad81-44e3-8dee-cfbdcbd0bbde req-8762dc1d-2a89-4ffc-8f8a-cf062dbdca93 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:37.367353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-ab654b0b-ad81-44e3-8dee-cfbdcbd0bbde req-8762dc1d-2a89-4ffc-8f8a-cf062dbdca93 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:37.380763 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a8aa112e-9f02-40de-81a2-9092fee03a46 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:37.384416 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-ab654b0b-ad81-44e3-8dee-cfbdcbd0bbde req-8762dc1d-2a89-4ffc-8f8a-cf062dbdca93 service nova] Creating event network-vif-deleted:e1afce7c-4bdd-432b-905f-443b0227fa80 for instance 98e6fc07-61b1-455d-8bf0-563c5debbebb on hv-cinder-85221 Aug 05 20:11:37.384995 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-a8aa112e-9f02-40de-81a2-9092fee03a46 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:37.391252 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-ab654b0b-ad81-44e3-8dee-cfbdcbd0bbde req-8762dc1d-2a89-4ffc-8f8a-cf062dbdca93 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044280 Aug 05 20:11:37.392684 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 460/897] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:37.395723 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a8aa112e-9f02-40de-81a2-9092fee03a46 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:37.396332 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a8aa112e-9f02-40de-81a2-9092fee03a46 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:37.396824 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a8aa112e-9f02-40de-81a2-9092fee03a46 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:37.397936 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a8aa112e-9f02-40de-81a2-9092fee03a46 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:37.398648 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a8aa112e-9f02-40de-81a2-9092fee03a46 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:37.399338 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a8aa112e-9f02-40de-81a2-9092fee03a46 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:37.430453 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:37.437466 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-a8aa112e-9f02-40de-81a2-9092fee03a46 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062248 Aug 05 20:11:37.438325 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 438/898] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Aug 5 20:11:37 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 05 20:11:37.538155 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-793a3aff-119d-4329-992e-9a4d57115be1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:37.538827 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-793a3aff-119d-4329-992e-9a4d57115be1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:37.546932 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-793a3aff-119d-4329-992e-9a4d57115be1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:37.547592 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-793a3aff-119d-4329-992e-9a4d57115be1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:37.548137 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-793a3aff-119d-4329-992e-9a4d57115be1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:37.552448 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-793a3aff-119d-4329-992e-9a4d57115be1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:37.553022 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-793a3aff-119d-4329-992e-9a4d57115be1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:37.553468 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-793a3aff-119d-4329-992e-9a4d57115be1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:37.581496 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-793a3aff-119d-4329-992e-9a4d57115be1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Going to try to terminate instance {{(pid=118192) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:11:37.670371 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-793a3aff-119d-4329-992e-9a4d57115be1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "DELETE /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 204 len: 0 microversion: 2.1 time: 0.136516 Aug 05 20:11:37.670960 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 461/899] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:11:37 2022] DELETE /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:11:37.679253 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-6bd8b9b2-2711-43bb-9bf8-31d658a5b9cd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:37.680152 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-6bd8b9b2-2711-43bb-9bf8-31d658a5b9cd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:37.686969 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9b2-2711-43bb-9bf8-31d658a5b9cd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:37.687378 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9b2-2711-43bb-9bf8-31d658a5b9cd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:37.687803 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9b2-2711-43bb-9bf8-31d658a5b9cd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:37.688884 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9b2-2711-43bb-9bf8-31d658a5b9cd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:37.689334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9b2-2711-43bb-9bf8-31d658a5b9cd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:37.689758 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6bd8b9b2-2711-43bb-9bf8-31d658a5b9cd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:37.835059 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-6bd8b9b2-2711-43bb-9bf8-31d658a5b9cd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:37.843347 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-6bd8b9b2-2711-43bb-9bf8-31d658a5b9cd tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1690 microversion: 2.1 time: 0.168223 Aug 05 20:11:37.843935 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 439/900] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:37 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:38.100217 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-9a736065-47cf-45d8-b370-1d715a743709 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:38.100944 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-9a736065-47cf-45d8-b370-1d715a743709 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:38.107352 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9a736065-47cf-45d8-b370-1d715a743709 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:38.107842 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9a736065-47cf-45d8-b370-1d715a743709 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:38.108287 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9a736065-47cf-45d8-b370-1d715a743709 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:38.109019 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9a736065-47cf-45d8-b370-1d715a743709 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:38.109475 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9a736065-47cf-45d8-b370-1d715a743709 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:38.109901 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9a736065-47cf-45d8-b370-1d715a743709 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:38.143724 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9a736065-47cf-45d8-b370-1d715a743709 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:38.144215 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9a736065-47cf-45d8-b370-1d715a743709 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:38.144680 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9a736065-47cf-45d8-b370-1d715a743709 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:38.145132 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.objects.instance [None req-9a736065-47cf-45d8-b370-1d715a743709 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lazy-loading 'fault' on Instance uuid 98e6fc07-61b1-455d-8bf0-563c5debbebb {{(pid=118192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:11:38.188439 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-9a736065-47cf-45d8-b370-1d715a743709 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:38.190771 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:38.198187 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-9a736065-47cf-45d8-b370-1d715a743709 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:38.200509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-9a736065-47cf-45d8-b370-1d715a743709 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:38.201705 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-9a736065-47cf-45d8-b370-1d715a743709 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1372 microversion: 2.20 time: 0.106020 Aug 05 20:11:38.202264 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 462/901] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:38 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:38.864844 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-217c738e-0898-4834-aa7b-4a2a5af7ff41 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:38.865494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-217c738e-0898-4834-aa7b-4a2a5af7ff41 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:38.872024 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-217c738e-0898-4834-aa7b-4a2a5af7ff41 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:38.872517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-217c738e-0898-4834-aa7b-4a2a5af7ff41 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:38.872981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-217c738e-0898-4834-aa7b-4a2a5af7ff41 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:38.873679 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-217c738e-0898-4834-aa7b-4a2a5af7ff41 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:38.874135 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-217c738e-0898-4834-aa7b-4a2a5af7ff41 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:38.874560 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-217c738e-0898-4834-aa7b-4a2a5af7ff41 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:39.006675 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-217c738e-0898-4834-aa7b-4a2a5af7ff41 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:39.014840 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-217c738e-0898-4834-aa7b-4a2a5af7ff41 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1690 microversion: 2.1 time: 0.154023 Aug 05 20:11:39.015404 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 440/902] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:38 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:39.225045 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-9acecbf2-9289-484d-94ee-8864dac1c0b6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:39.225610 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-9acecbf2-9289-484d-94ee-8864dac1c0b6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:39.233934 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9acecbf2-9289-484d-94ee-8864dac1c0b6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:39.234430 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9acecbf2-9289-484d-94ee-8864dac1c0b6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:39.234907 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9acecbf2-9289-484d-94ee-8864dac1c0b6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:39.235623 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9acecbf2-9289-484d-94ee-8864dac1c0b6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:39.236081 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9acecbf2-9289-484d-94ee-8864dac1c0b6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:39.236514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9acecbf2-9289-484d-94ee-8864dac1c0b6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:39.268932 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9acecbf2-9289-484d-94ee-8864dac1c0b6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:39.269420 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9acecbf2-9289-484d-94ee-8864dac1c0b6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:39.269860 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9acecbf2-9289-484d-94ee-8864dac1c0b6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:39.270339 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.objects.instance [None req-9acecbf2-9289-484d-94ee-8864dac1c0b6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lazy-loading 'fault' on Instance uuid 98e6fc07-61b1-455d-8bf0-563c5debbebb {{(pid=118192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:11:39.314059 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-9acecbf2-9289-484d-94ee-8864dac1c0b6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:39.322098 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-9acecbf2-9289-484d-94ee-8864dac1c0b6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:39.323605 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-9acecbf2-9289-484d-94ee-8864dac1c0b6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:39.324826 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-9acecbf2-9289-484d-94ee-8864dac1c0b6 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1372 microversion: 2.20 time: 0.103743 Aug 05 20:11:39.325387 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 463/903] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:39 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:40.035572 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-ca940fd8-bbac-49ae-bad9-d4faa44a6883 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:40.036124 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-ca940fd8-bbac-49ae-bad9-d4faa44a6883 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:40.042639 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ca940fd8-bbac-49ae-bad9-d4faa44a6883 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:40.043128 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ca940fd8-bbac-49ae-bad9-d4faa44a6883 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:40.043568 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ca940fd8-bbac-49ae-bad9-d4faa44a6883 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:40.044263 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ca940fd8-bbac-49ae-bad9-d4faa44a6883 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:40.045488 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ca940fd8-bbac-49ae-bad9-d4faa44a6883 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:40.046002 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ca940fd8-bbac-49ae-bad9-d4faa44a6883 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:40.185710 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-ca940fd8-bbac-49ae-bad9-d4faa44a6883 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:40.193447 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-ca940fd8-bbac-49ae-bad9-d4faa44a6883 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1690 microversion: 2.1 time: 0.161813 Aug 05 20:11:40.194021 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 441/904] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:40 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:40.348111 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-edf70d55-c039-4d18-92e4-f3b72f37d091 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:40.348676 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-edf70d55-c039-4d18-92e4-f3b72f37d091 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:40.355075 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-edf70d55-c039-4d18-92e4-f3b72f37d091 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:40.355554 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-edf70d55-c039-4d18-92e4-f3b72f37d091 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:40.355984 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-edf70d55-c039-4d18-92e4-f3b72f37d091 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:40.356692 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-edf70d55-c039-4d18-92e4-f3b72f37d091 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:40.357792 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-edf70d55-c039-4d18-92e4-f3b72f37d091 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:40.358217 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-edf70d55-c039-4d18-92e4-f3b72f37d091 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:40.388284 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-edf70d55-c039-4d18-92e4-f3b72f37d091 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:40.389010 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-edf70d55-c039-4d18-92e4-f3b72f37d091 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:40.389443 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-edf70d55-c039-4d18-92e4-f3b72f37d091 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:40.389889 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.objects.instance [None req-edf70d55-c039-4d18-92e4-f3b72f37d091 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lazy-loading 'fault' on Instance uuid 98e6fc07-61b1-455d-8bf0-563c5debbebb {{(pid=118192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:11:40.431084 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-edf70d55-c039-4d18-92e4-f3b72f37d091 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:40.440032 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-edf70d55-c039-4d18-92e4-f3b72f37d091 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:40.441578 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-edf70d55-c039-4d18-92e4-f3b72f37d091 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:40.442800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-edf70d55-c039-4d18-92e4-f3b72f37d091 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 200 len: 1372 microversion: 2.20 time: 0.098583 Aug 05 20:11:40.443362 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 464/905] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:40 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:41.214820 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7e009618-6fc1-423f-a30c-fb2f59c351d0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:41.215425 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-7e009618-6fc1-423f-a30c-fb2f59c351d0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:41.218100 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:41.224037 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7e009618-6fc1-423f-a30c-fb2f59c351d0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:41.224537 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7e009618-6fc1-423f-a30c-fb2f59c351d0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:41.224998 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7e009618-6fc1-423f-a30c-fb2f59c351d0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:41.225707 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7e009618-6fc1-423f-a30c-fb2f59c351d0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:41.226163 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7e009618-6fc1-423f-a30c-fb2f59c351d0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:41.226588 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7e009618-6fc1-423f-a30c-fb2f59c351d0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:41.367084 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-7e009618-6fc1-423f-a30c-fb2f59c351d0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:41.376121 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-7e009618-6fc1-423f-a30c-fb2f59c351d0 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1690 microversion: 2.1 time: 0.165150 Aug 05 20:11:41.376737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 442/906] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:41 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:41.469600 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ac57407e-5eed-477b-9f6b-4dc6964abe94 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:41.470195 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-ac57407e-5eed-477b-9f6b-4dc6964abe94 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:41.477533 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ac57407e-5eed-477b-9f6b-4dc6964abe94 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:41.478019 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ac57407e-5eed-477b-9f6b-4dc6964abe94 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:41.478551 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ac57407e-5eed-477b-9f6b-4dc6964abe94 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:41.479151 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ac57407e-5eed-477b-9f6b-4dc6964abe94 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:41.479603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ac57407e-5eed-477b-9f6b-4dc6964abe94 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:41.480025 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ac57407e-5eed-477b-9f6b-4dc6964abe94 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:41.494650 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-ac57407e-5eed-477b-9f6b-4dc6964abe94 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] HTTP exception thrown: Instance 98e6fc07-61b1-455d-8bf0-563c5debbebb could not be found. Aug 05 20:11:41.496353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ac57407e-5eed-477b-9f6b-4dc6964abe94 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Request method failure captured: Aug 05 20:11:41.496353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb HTTP/1.1 Aug 05 20:11:41.496353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:11:41.496353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:11:41.496353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:11:41.496353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 0 Aug 05 20:11:41.496353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:11:41.496353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:11:41.496353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:11:41.496353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:11:41.496353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XflUr6pMFYGyAct_pxI2Tj049c_XZuQFJMkzUqRUGwj-hQJDlurKTD3OVG5neYfGUOViwmRomj5cShcddXo6F9i8LvUsRkqgKBFJGesXbj1lG7l-7aUNEdkEIT7S3_oubonM6XBVeHzi6bRwAbwq_1FwCx4IhqPBtHseSu65ZuaPvs Aug 05 20:11:41.496353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:11:41.496353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:11:41.496353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:11:41.496353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:11:41.496353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 20:11:41.496353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:11:41.496353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:11:41.496353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: aa4789b47e0f47b0acd1cc4919593c33 Aug 05 20:11:41.496353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1646958349 Aug 05 20:11:41.496353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:11:41.496353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:11:41.499486 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/aa4789b47e0f47b0acd1cc4919593c33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/aa4789b47e0f47b0acd1cc4919593c33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/aa4789b47e0f47b0acd1cc4919593c33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_aa4789b47e0f47b0acd1cc4919593c33", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:11:41.499486 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1646958349 Aug 05 20:11:41.499486 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: aa4789b47e0f47b0acd1cc4919593c33 Aug 05 20:11:41.499486 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1646958349 Aug 05 20:11:41.499486 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-AttachVolumeShelveTestJSON-1646958349-project Aug 05 20:11:41.499486 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:11:41.499486 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:11:41.499486 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: 160c88a7ba0144d4b1bc953767b12bb7 Aug 05 20:11:41.499486 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1646958349-project Aug 05 20:11:41.499486 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: > Aug 05 20:11:41.499486 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Instance 98e6fc07-61b1-455d-8bf0-563c5debbebb could not be found. Aug 05 20:11:41.499486 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'id': '98e6fc07-61b1-455d-8bf0-563c5debbebb'} Aug 05 20:11:41.501167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:11:41.501167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:11:41.501167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:11:41.501167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:11:41.501167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:11:41.501167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:11:41.501167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:11:41.501167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:11:41.501167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:11:41.501167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:11:41.501167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98e6fc07-61b1-455d-8bf0-563c5debbebb could not be found. Aug 05 20:11:41.501167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:11:41.501167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:11:41.501167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:11:41.501167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:11:41.501167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:11:41.501167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:11:41.501167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:11:41.501167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:11:41.501167 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:11:41.504007 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:11:41.504007 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:11:41.504007 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:11:41.504007 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:11:41.504007 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:11:41.504007 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:11:41.504007 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:11:41.504007 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98e6fc07-61b1-455d-8bf0-563c5debbebb could not be found. Aug 05 20:11:41.504007 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:11:41.504007 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:11:41.504007 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:11:41.504007 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:11:41.504007 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:11:41.504007 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:11:41.504007 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:11:41.504007 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:11:41.504007 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98e6fc07-61b1-455d-8bf0-563c5debbebb could not be found. Aug 05 20:11:41.504007 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:11:41.507528 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ac57407e-5eed-477b-9f6b-4dc6964abe94 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Returning 404 to user: Instance 98e6fc07-61b1-455d-8bf0-563c5debbebb could not be found. {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:11:41.507528 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-ac57407e-5eed-477b-9f6b-4dc6964abe94 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 404 len: 111 microversion: 2.20 time: 0.032199 Aug 05 20:11:41.507528 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 465/907] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:41 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 20:11:41.515513 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-29805abf-fa28-4854-987c-16731d998e72 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '.version_select at 0x7fe3e43a58b0>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:41.547174 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-29805abf-fa28-4854-987c-16731d998e72 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1390974380" status: 204 len: 0 microversion: 2.20 time: 0.036076 Aug 05 20:11:41.547174 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 443/908] 10.222.0.39 () {60 vars in 1262 bytes} [Fri Aug 5 20:11:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1390974380 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 20:11:42.267368 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-645cdc8d-f9fd-4fb3-9aa5-6581d49f9ab1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Action: 'create', calling method: .version_select at 0x7fe3e443b940>, body: {"keypair": {"name": "tempest-keypair-1764935559", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxcrYyAzk3nZ89l6s+Ps7WS8hHMtfwg2V/3X8s0mpfaKP9mRjIgFo3pe06HA3B3I2rCqubPjUbh5xB7Ve8DJ0c0LXqGdUWsq3IY2Gc2Wzyw/DGBZXopqVlTDvxq7hWFuQ=="}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:42.287146 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-645cdc8d-f9fd-4fb3-9aa5-6581d49f9ab1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Getting quotas for project aa4789b47e0f47b0acd1cc4919593c33. Resources: {'key_pairs'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:11:42.293290 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-645cdc8d-f9fd-4fb3-9aa5-6581d49f9ab1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Getting quotas for user 160c88a7ba0144d4b1bc953767b12bb7 and project aa4789b47e0f47b0acd1cc4919593c33. Resources: {'key_pairs'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:11:42.319617 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-645cdc8d-f9fd-4fb3-9aa5-6581d49f9ab1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.057308 Aug 05 20:11:42.320732 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 466/909] 10.222.0.39 () {62 vars in 1200 bytes} [Fri Aug 5 20:11:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 05 20:11:42.338711 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-f9ecda81-16c0-4012-97cf-d4ae27c2ffc3 req-04a38877-1a3a-4da0-b9c5-6fc53882e969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1", "name": "network-vif-deleted", "tag": "780a6046-5a34-4fe1-b8f7-b847e0fc78b0"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:42.354074 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-f9ecda81-16c0-4012-97cf-d4ae27c2ffc3 req-04a38877-1a3a-4da0-b9c5-6fc53882e969 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:42.358012 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-f9ecda81-16c0-4012-97cf-d4ae27c2ffc3 req-04a38877-1a3a-4da0-b9c5-6fc53882e969 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:42.358481 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-f9ecda81-16c0-4012-97cf-d4ae27c2ffc3 req-04a38877-1a3a-4da0-b9c5-6fc53882e969 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:42.380342 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-f9ecda81-16c0-4012-97cf-d4ae27c2ffc3 req-04a38877-1a3a-4da0-b9c5-6fc53882e969 service nova] Creating event network-vif-deleted:780a6046-5a34-4fe1-b8f7-b847e0fc78b0 for instance 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 on hv-cinder-85221 Aug 05 20:11:42.388372 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-f9ecda81-16c0-4012-97cf-d4ae27c2ffc3 req-04a38877-1a3a-4da0-b9c5-6fc53882e969 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053737 Aug 05 20:11:42.389493 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 444/910] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:11:42.401611 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-bbf7f95a-7f3a-4974-b96c-9276496dbcfb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:42.402587 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-bbf7f95a-7f3a-4974-b96c-9276496dbcfb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:42.414580 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-bbf7f95a-7f3a-4974-b96c-9276496dbcfb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:42.415385 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-bbf7f95a-7f3a-4974-b96c-9276496dbcfb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:42.416036 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-bbf7f95a-7f3a-4974-b96c-9276496dbcfb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:42.417024 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-bbf7f95a-7f3a-4974-b96c-9276496dbcfb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:42.417657 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-bbf7f95a-7f3a-4974-b96c-9276496dbcfb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:42.418254 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-bbf7f95a-7f3a-4974-b96c-9276496dbcfb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:42.544249 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-bbf7f95a-7f3a-4974-b96c-9276496dbcfb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:42.568020 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-bbf7f95a-7f3a-4974-b96c-9276496dbcfb tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 200 len: 1330 microversion: 2.1 time: 0.171414 Aug 05 20:11:42.581938 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 467/911] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:42 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 1330 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:43.600722 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7c4a8ccc-efe9-41ea-aa1b-a53c65d6b250 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:43.602276 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-7c4a8ccc-efe9-41ea-aa1b-a53c65d6b250 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:43.610243 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7c4a8ccc-efe9-41ea-aa1b-a53c65d6b250 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:43.611131 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7c4a8ccc-efe9-41ea-aa1b-a53c65d6b250 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:43.612064 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7c4a8ccc-efe9-41ea-aa1b-a53c65d6b250 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:43.613310 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7c4a8ccc-efe9-41ea-aa1b-a53c65d6b250 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:43.614017 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7c4a8ccc-efe9-41ea-aa1b-a53c65d6b250 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:43.614715 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7c4a8ccc-efe9-41ea-aa1b-a53c65d6b250 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:43.633626 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-7c4a8ccc-efe9-41ea-aa1b-a53c65d6b250 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] HTTP exception thrown: Instance 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 could not be found. Aug 05 20:11:43.636053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7c4a8ccc-efe9-41ea-aa1b-a53c65d6b250 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Request method failure captured: Aug 05 20:11:43.636053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 HTTP/1.1 Aug 05 20:11:43.636053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:11:43.636053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:11:43.636053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:11:43.636053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:11:43.636053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:11:43.636053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:11:43.636053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:11:43.636053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:11:43.636053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XdnvYt02KSUfuGZ4aMCLRd8A9W_4ugESxync32oagoq2m1bRquV2YcYbZy923ze2HKyg5orLp5ZPgQwQNpL1ZwXjKJN6rbHklb_4GvGBhZZEq-4iAyROqoLvdfOlApZwfRc8nLpUC3uM58ekKbcVuoIhI3WM4aUZiobfffRTVMm8jY Aug 05 20:11:43.636053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:11:43.636053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:11:43.636053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:11:43.636053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:11:43.636053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:11:43.636053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:11:43.636053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: c5b5718607784ec9be3289f7916f70a6 Aug 05 20:11:43.636053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1357645261 Aug 05 20:11:43.636053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:11:43.636053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:11:43.637473 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c5b5718607784ec9be3289f7916f70a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c5b5718607784ec9be3289f7916f70a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c5b5718607784ec9be3289f7916f70a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c5b5718607784ec9be3289f7916f70a6", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:11:43.637473 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1357645261 Aug 05 20:11:43.637473 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: c5b5718607784ec9be3289f7916f70a6 Aug 05 20:11:43.637473 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1357645261 Aug 05 20:11:43.637473 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-ServerRescueNegativeTestJSON-1357645261-project Aug 05 20:11:43.637473 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:11:43.637473 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:11:43.637473 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: 293b8a62f19c45c1bf5b897c7cf40edb Aug 05 20:11:43.637473 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1357645261-project Aug 05 20:11:43.637473 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: > Aug 05 20:11:43.637473 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Instance 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 could not be found. Aug 05 20:11:43.637473 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'id': '96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1'} Aug 05 20:11:43.638944 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:11:43.638944 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:11:43.638944 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:11:43.638944 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:11:43.638944 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:11:43.638944 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:11:43.638944 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:11:43.638944 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:11:43.638944 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:11:43.638944 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:11:43.638944 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 could not be found. Aug 05 20:11:43.638944 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:11:43.638944 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:11:43.638944 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:11:43.638944 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:11:43.638944 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:11:43.638944 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:11:43.638944 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:11:43.638944 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:11:43.638944 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:11:43.640688 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:11:43.640688 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:11:43.640688 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:11:43.640688 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:11:43.640688 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:11:43.640688 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:11:43.640688 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:11:43.640688 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 could not be found. Aug 05 20:11:43.640688 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:11:43.640688 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:11:43.640688 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:11:43.640688 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:11:43.640688 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:11:43.640688 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:11:43.640688 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:11:43.640688 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:11:43.640688 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 could not be found. Aug 05 20:11:43.640688 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:11:43.643042 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7c4a8ccc-efe9-41ea-aa1b-a53c65d6b250 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Returning 404 to user: Instance 96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 could not be found. {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:11:43.644270 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-7c4a8ccc-efe9-41ea-aa1b-a53c65d6b250 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1" status: 404 len: 111 microversion: 2.1 time: 0.048517 Aug 05 20:11:43.645373 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 445/912] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:43 2022] GET /compute/v2.1/servers/96d78c2f-1afe-4ad5-8c49-1bfd9d4323d1 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:11:43.655064 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-391c965d-3b5a-4145-9c61-1af4d5a5b140 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '.version_select at 0x7fe3e43ecb80>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:43.680869 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-391c965d-3b5a-4145-9c61-1af4d5a5b140 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200964215" status: 202 len: 0 microversion: 2.1 time: 0.030131 Aug 05 20:11:43.694535 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 468/913] 10.222.0.39 () {58 vars in 1221 bytes} [Fri Aug 5 20:11:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200964215 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:11:43.839430 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-308b5855-5c9c-4663-9017-d89ad95543c1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1419108077", "imageRef": "c148255e-9574-4d10-b9bb-13c9411eda77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "667c5e25-02e4-496c-8462-d182e3d7b511"}], "security_groups": [{"name": "tempest-securitygroup--1639306045"}], "key_name": "tempest-keypair-1764935559", "user_data": "}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:43.958798 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.network.neutron [None req-308b5855-5c9c-4663-9017-d89ad95543c1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] validate_networks() for [('667c5e25-02e4-496c-8462-d182e3d7b511', None, None, None, None, None)] {{(pid=118191) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:11:44.409196 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-308b5855-5c9c-4663-9017-d89ad95543c1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Flavor limits 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:11:44.409708 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-308b5855-5c9c-4663-9017-d89ad95543c1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Image limits 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:11:44.410320 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-308b5855-5c9c-4663-9017-d89ad95543c1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Flavor pref 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:11:44.411026 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-308b5855-5c9c-4663-9017-d89ad95543c1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Image pref 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:11:44.411536 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-308b5855-5c9c-4663-9017-d89ad95543c1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:11:44.422322 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-308b5855-5c9c-4663-9017-d89ad95543c1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:44.422886 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-308b5855-5c9c-4663-9017-d89ad95543c1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:44.423700 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-308b5855-5c9c-4663-9017-d89ad95543c1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:44.424513 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-308b5855-5c9c-4663-9017-d89ad95543c1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:44.425493 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-308b5855-5c9c-4663-9017-d89ad95543c1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:44.425493 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-308b5855-5c9c-4663-9017-d89ad95543c1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:44.451971 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-308b5855-5c9c-4663-9017-d89ad95543c1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Getting quotas for project aa4789b47e0f47b0acd1cc4919593c33. Resources: {'cores', 'ram', 'instances'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:11:44.456404 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-308b5855-5c9c-4663-9017-d89ad95543c1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Getting quotas for user 160c88a7ba0144d4b1bc953767b12bb7 and project aa4789b47e0f47b0acd1cc4919593c33. Resources: {'cores', 'ram', 'instances'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:11:44.469071 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-308b5855-5c9c-4663-9017-d89ad95543c1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Going to run 1 instances... {{(pid=118191) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:11:44.471381 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-308b5855-5c9c-4663-9017-d89ad95543c1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c148255e-9574-4d10-b9bb-13c9411eda77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118191) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:11:44.522818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-308b5855-5c9c-4663-9017-d89ad95543c1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.687614 Aug 05 20:11:44.523915 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 446/914] 10.222.0.39 () {62 vars in 1188 bytes} [Fri Aug 5 20:11:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 05 20:11:44.542608 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-1414e351-6c2c-44bc-bbc8-b2c376e41311 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:44.544073 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-1414e351-6c2c-44bc-bbc8-b2c376e41311 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:44.606174 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-1414e351-6c2c-44bc-bbc8-b2c376e41311 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:44.614838 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-1414e351-6c2c-44bc-bbc8-b2c376e41311 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:44.616356 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-1414e351-6c2c-44bc-bbc8-b2c376e41311 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:44.617488 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-1414e351-6c2c-44bc-bbc8-b2c376e41311 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1282 microversion: 2.20 time: 0.084810 Aug 05 20:11:44.618039 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 469/915] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:44 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1282 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:45.642120 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-c74c0c0d-d45c-4304-9b0b-07de6ea11cea tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:45.642728 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-c74c0c0d-d45c-4304-9b0b-07de6ea11cea tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:45.649743 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c74c0c0d-d45c-4304-9b0b-07de6ea11cea tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:45.650322 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c74c0c0d-d45c-4304-9b0b-07de6ea11cea tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:45.650787 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c74c0c0d-d45c-4304-9b0b-07de6ea11cea tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:45.651646 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c74c0c0d-d45c-4304-9b0b-07de6ea11cea tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:45.652111 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c74c0c0d-d45c-4304-9b0b-07de6ea11cea tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:45.652537 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c74c0c0d-d45c-4304-9b0b-07de6ea11cea tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:45.735682 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-c74c0c0d-d45c-4304-9b0b-07de6ea11cea tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:45.749332 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-c74c0c0d-d45c-4304-9b0b-07de6ea11cea tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:45.751567 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-c74c0c0d-d45c-4304-9b0b-07de6ea11cea tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:45.753921 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-c74c0c0d-d45c-4304-9b0b-07de6ea11cea tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1342 microversion: 2.20 time: 0.116614 Aug 05 20:11:45.754809 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 447/916] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:45 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1342 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:46.723688 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-750c210f-c60e-4488-b659-922902e01393 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:46.724894 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-750c210f-c60e-4488-b659-922902e01393 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:46.736496 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-750c210f-c60e-4488-b659-922902e01393 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:46.737040 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-750c210f-c60e-4488-b659-922902e01393 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:46.737680 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-750c210f-c60e-4488-b659-922902e01393 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:46.738428 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-750c210f-c60e-4488-b659-922902e01393 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:46.739642 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-750c210f-c60e-4488-b659-922902e01393 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:46.740282 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-750c210f-c60e-4488-b659-922902e01393 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:46.772837 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-750c210f-c60e-4488-b659-922902e01393 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Going to try to terminate instance {{(pid=118192) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:11:46.781657 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-b2bae48b-e362-4823-88fb-620f06d9e23d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:46.782863 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-b2bae48b-e362-4823-88fb-620f06d9e23d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:46.789452 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b2bae48b-e362-4823-88fb-620f06d9e23d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:46.790025 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b2bae48b-e362-4823-88fb-620f06d9e23d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:46.790522 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b2bae48b-e362-4823-88fb-620f06d9e23d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:46.791663 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b2bae48b-e362-4823-88fb-620f06d9e23d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:46.792218 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b2bae48b-e362-4823-88fb-620f06d9e23d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:46.792756 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b2bae48b-e362-4823-88fb-620f06d9e23d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:46.869338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-750c210f-c60e-4488-b659-922902e01393 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 204 len: 0 microversion: 2.1 time: 0.149726 Aug 05 20:11:46.870311 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 470/917] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:11:46 2022] DELETE /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:11:46.881311 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-cd0c8a2b-8412-43e0-a5b8-c4ae238ad4d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:46.881820 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-cd0c8a2b-8412-43e0-a5b8-c4ae238ad4d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:46.889787 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cd0c8a2b-8412-43e0-a5b8-c4ae238ad4d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:46.890423 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cd0c8a2b-8412-43e0-a5b8-c4ae238ad4d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:46.890871 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cd0c8a2b-8412-43e0-a5b8-c4ae238ad4d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:46.891607 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cd0c8a2b-8412-43e0-a5b8-c4ae238ad4d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:46.892057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cd0c8a2b-8412-43e0-a5b8-c4ae238ad4d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:46.892479 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cd0c8a2b-8412-43e0-a5b8-c4ae238ad4d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:47.114165 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-b2bae48b-e362-4823-88fb-620f06d9e23d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:47.124058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-b2bae48b-e362-4823-88fb-620f06d9e23d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:47.125714 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-b2bae48b-e362-4823-88fb-620f06d9e23d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:47.126873 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-b2bae48b-e362-4823-88fb-620f06d9e23d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1408 microversion: 2.20 time: 0.351157 Aug 05 20:11:47.127444 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 448/918] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:46 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1408 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:11:47.166699 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-cd0c8a2b-8412-43e0-a5b8-c4ae238ad4d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:47.175111 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-cd0c8a2b-8412-43e0-a5b8-c4ae238ad4d1 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1508 microversion: 2.1 time: 0.299518 Aug 05 20:11:47.175791 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 471/919] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:46 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1508 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:47.471964 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-27df8def-1976-4dfe-97d1-8d165ec569c6 req-5053b38b-8174-4e8e-944b-45422faf51eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4869087-6b2c-466b-beb3-36ad64c5d5eb", "tag": "13a23b2f-953f-46e0-b2af-1d2023dbbe54"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:47.481612 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-27df8def-1976-4dfe-97d1-8d165ec569c6 req-5053b38b-8174-4e8e-944b-45422faf51eb service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:47.482734 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-27df8def-1976-4dfe-97d1-8d165ec569c6 req-5053b38b-8174-4e8e-944b-45422faf51eb service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:47.483182 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-27df8def-1976-4dfe-97d1-8d165ec569c6 req-5053b38b-8174-4e8e-944b-45422faf51eb service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:47.494731 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-27df8def-1976-4dfe-97d1-8d165ec569c6 req-5053b38b-8174-4e8e-944b-45422faf51eb service nova] Creating event network-changed:13a23b2f-953f-46e0-b2af-1d2023dbbe54 for instance e4869087-6b2c-466b-beb3-36ad64c5d5eb on hv-cinder-85221 Aug 05 20:11:47.499984 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-27df8def-1976-4dfe-97d1-8d165ec569c6 req-5053b38b-8174-4e8e-944b-45422faf51eb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031664 Aug 05 20:11:47.500631 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 449/920] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:11:48.150640 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-16104f0c-6f57-4339-b244-37863fc61e51 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:48.151245 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-16104f0c-6f57-4339-b244-37863fc61e51 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:48.159606 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-16104f0c-6f57-4339-b244-37863fc61e51 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:48.160009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-16104f0c-6f57-4339-b244-37863fc61e51 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:48.160441 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-16104f0c-6f57-4339-b244-37863fc61e51 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:48.161252 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-16104f0c-6f57-4339-b244-37863fc61e51 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:48.161704 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-16104f0c-6f57-4339-b244-37863fc61e51 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:48.162127 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-16104f0c-6f57-4339-b244-37863fc61e51 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:48.201659 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-539bfde6-8f49-4357-94fc-b2a994cf27b7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:48.202372 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-539bfde6-8f49-4357-94fc-b2a994cf27b7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:48.209135 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-539bfde6-8f49-4357-94fc-b2a994cf27b7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:48.209638 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-539bfde6-8f49-4357-94fc-b2a994cf27b7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:48.210072 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-539bfde6-8f49-4357-94fc-b2a994cf27b7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:48.210791 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-539bfde6-8f49-4357-94fc-b2a994cf27b7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:48.211246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-539bfde6-8f49-4357-94fc-b2a994cf27b7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:48.211671 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-539bfde6-8f49-4357-94fc-b2a994cf27b7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:48.757804 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-539bfde6-8f49-4357-94fc-b2a994cf27b7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:48.762491 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-16104f0c-6f57-4339-b244-37863fc61e51 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:48.768355 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-539bfde6-8f49-4357-94fc-b2a994cf27b7 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 200 len: 1508 microversion: 2.1 time: 0.575292 Aug 05 20:11:48.770167 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 450/921] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:48 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 1508 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:48.784139 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-16104f0c-6f57-4339-b244-37863fc61e51 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:48.787316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-16104f0c-6f57-4339-b244-37863fc61e51 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:48.789656 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-16104f0c-6f57-4339-b244-37863fc61e51 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1408 microversion: 2.20 time: 0.642726 Aug 05 20:11:48.805114 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 472/922] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:48 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1408 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:49.514674 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-636e0ffe-438a-45c3-8865-c440c2108543 req-4d3441f1-56c5-41b1-a742-aa8725e757a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d", "name": "network-vif-deleted", "tag": "d0ef51ee-a75a-482b-8bfb-3cb689fe05cd"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:49.524365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-636e0ffe-438a-45c3-8865-c440c2108543 req-4d3441f1-56c5-41b1-a742-aa8725e757a5 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:49.524875 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-636e0ffe-438a-45c3-8865-c440c2108543 req-4d3441f1-56c5-41b1-a742-aa8725e757a5 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:49.525304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-636e0ffe-438a-45c3-8865-c440c2108543 req-4d3441f1-56c5-41b1-a742-aa8725e757a5 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:49.538191 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-636e0ffe-438a-45c3-8865-c440c2108543 req-4d3441f1-56c5-41b1-a742-aa8725e757a5 service nova] Creating event network-vif-deleted:d0ef51ee-a75a-482b-8bfb-3cb689fe05cd for instance c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d on hv-cinder-85221 Aug 05 20:11:49.543022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-636e0ffe-438a-45c3-8865-c440c2108543 req-4d3441f1-56c5-41b1-a742-aa8725e757a5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032647 Aug 05 20:11:49.543608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 451/923] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:49.807406 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-773da39c-04d9-4e4b-b1ce-535012c8b195 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:49.808024 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-773da39c-04d9-4e4b-b1ce-535012c8b195 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:49.814958 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-773da39c-04d9-4e4b-b1ce-535012c8b195 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:49.815446 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-773da39c-04d9-4e4b-b1ce-535012c8b195 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:49.815896 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-773da39c-04d9-4e4b-b1ce-535012c8b195 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:49.816638 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-773da39c-04d9-4e4b-b1ce-535012c8b195 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:49.817872 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-773da39c-04d9-4e4b-b1ce-535012c8b195 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:49.818667 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-773da39c-04d9-4e4b-b1ce-535012c8b195 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:49.827038 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-82d1ed3d-b4ba-4dc2-a58c-1320e87dd16a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:49.827749 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-82d1ed3d-b4ba-4dc2-a58c-1320e87dd16a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:49.834460 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-82d1ed3d-b4ba-4dc2-a58c-1320e87dd16a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:49.835312 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-82d1ed3d-b4ba-4dc2-a58c-1320e87dd16a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:49.835774 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-82d1ed3d-b4ba-4dc2-a58c-1320e87dd16a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:49.836480 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-82d1ed3d-b4ba-4dc2-a58c-1320e87dd16a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:49.836634 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-773da39c-04d9-4e4b-b1ce-535012c8b195 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] HTTP exception thrown: Instance c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d could not be found. Aug 05 20:11:49.836965 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-82d1ed3d-b4ba-4dc2-a58c-1320e87dd16a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:49.837409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-82d1ed3d-b4ba-4dc2-a58c-1320e87dd16a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:49.838323 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-773da39c-04d9-4e4b-b1ce-535012c8b195 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Request method failure captured: Aug 05 20:11:49.838323 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d HTTP/1.1 Aug 05 20:11:49.838323 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:11:49.838323 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:11:49.838323 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:11:49.838323 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 0 Aug 05 20:11:49.838323 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:11:49.838323 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:11:49.838323 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:11:49.838323 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:11:49.838323 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XdnvYt02KSUfuGZ4aMCLRd8A9W_4ugESxync32oagoq2m1bRquV2YcYbZy923ze2HKyg5orLp5ZPgQwQNpL1ZwXjKJN6rbHklb_4GvGBhZZEq-4iAyROqoLvdfOlApZwfRc8nLpUC3uM58ekKbcVuoIhI3WM4aUZiobfffRTVMm8jY Aug 05 20:11:49.838323 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:11:49.838323 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:11:49.838323 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:11:49.838323 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:11:49.838323 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:11:49.838323 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:11:49.838323 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: c5b5718607784ec9be3289f7916f70a6 Aug 05 20:11:49.838323 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1357645261 Aug 05 20:11:49.838323 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:11:49.838323 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:11:49.839775 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c5b5718607784ec9be3289f7916f70a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c5b5718607784ec9be3289f7916f70a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c5b5718607784ec9be3289f7916f70a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c5b5718607784ec9be3289f7916f70a6", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:11:49.839775 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1357645261 Aug 05 20:11:49.839775 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: c5b5718607784ec9be3289f7916f70a6 Aug 05 20:11:49.839775 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1357645261 Aug 05 20:11:49.839775 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-ServerRescueNegativeTestJSON-1357645261-project Aug 05 20:11:49.839775 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:11:49.839775 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:11:49.839775 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: 293b8a62f19c45c1bf5b897c7cf40edb Aug 05 20:11:49.839775 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1357645261-project Aug 05 20:11:49.839775 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: > Aug 05 20:11:49.839775 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Instance c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d could not be found. Aug 05 20:11:49.839775 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'id': 'c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d'} Aug 05 20:11:49.840603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:11:49.840603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:11:49.840603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:11:49.840603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:11:49.840603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:11:49.840603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:11:49.840603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:11:49.840603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:11:49.840603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:11:49.840603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:11:49.840603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d could not be found. Aug 05 20:11:49.840603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:11:49.840603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:11:49.840603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:11:49.840603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:11:49.840603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:11:49.840603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:11:49.840603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:11:49.840603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:11:49.840603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:11:49.843226 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:11:49.843226 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:11:49.843226 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:11:49.843226 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:11:49.843226 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:11:49.843226 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:11:49.843226 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:11:49.843226 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d could not be found. Aug 05 20:11:49.843226 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:11:49.843226 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:11:49.843226 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:11:49.843226 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:11:49.843226 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:11:49.843226 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:11:49.843226 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:11:49.843226 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:11:49.843226 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d could not be found. Aug 05 20:11:49.843226 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:11:49.844531 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-773da39c-04d9-4e4b-b1ce-535012c8b195 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Returning 404 to user: Instance c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d could not be found. {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:11:49.844531 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-773da39c-04d9-4e4b-b1ce-535012c8b195 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d" status: 404 len: 111 microversion: 2.1 time: 0.036437 Aug 05 20:11:49.844531 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 473/924] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:49 2022] GET /compute/v2.1/servers/c12fb0f5-51ed-4d7d-a900-b5aee9ebc78d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:11:49.849760 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-d19755fe-b8f9-4888-834d-4a96ddf009a8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:49.850340 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-d19755fe-b8f9-4888-834d-4a96ddf009a8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:49.859000 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d19755fe-b8f9-4888-834d-4a96ddf009a8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:49.859601 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d19755fe-b8f9-4888-834d-4a96ddf009a8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:49.860119 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d19755fe-b8f9-4888-834d-4a96ddf009a8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:49.860874 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d19755fe-b8f9-4888-834d-4a96ddf009a8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:49.861344 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d19755fe-b8f9-4888-834d-4a96ddf009a8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:49.861775 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d19755fe-b8f9-4888-834d-4a96ddf009a8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:49.888726 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-d19755fe-b8f9-4888-834d-4a96ddf009a8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Going to try to terminate instance {{(pid=118192) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:11:49.972368 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-d19755fe-b8f9-4888-834d-4a96ddf009a8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "DELETE /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 204 len: 0 microversion: 2.1 time: 0.125990 Aug 05 20:11:49.973421 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 474/925] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:11:49 2022] DELETE /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:11:49.982798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-49975097-3855-49d1-8212-464f45ebb969 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:49.983578 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-49975097-3855-49d1-8212-464f45ebb969 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:49.984617 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-82d1ed3d-b4ba-4dc2-a58c-1320e87dd16a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:49.989830 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-49975097-3855-49d1-8212-464f45ebb969 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:49.990360 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-49975097-3855-49d1-8212-464f45ebb969 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:49.990879 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-49975097-3855-49d1-8212-464f45ebb969 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:49.991568 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-49975097-3855-49d1-8212-464f45ebb969 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:49.992038 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-49975097-3855-49d1-8212-464f45ebb969 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:49.992463 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-49975097-3855-49d1-8212-464f45ebb969 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:49.994683 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-82d1ed3d-b4ba-4dc2-a58c-1320e87dd16a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:49.995045 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-82d1ed3d-b4ba-4dc2-a58c-1320e87dd16a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:49.996362 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-82d1ed3d-b4ba-4dc2-a58c-1320e87dd16a tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1408 microversion: 2.20 time: 0.176158 Aug 05 20:11:49.996779 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 452/926] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:49 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:50.131281 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-49975097-3855-49d1-8212-464f45ebb969 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:50.139305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-49975097-3855-49d1-8212-464f45ebb969 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.161683 Aug 05 20:11:50.140171 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 475/927] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:49 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:51.020136 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3f3bb82a-2fe8-4893-9124-9e39a22c5723 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:51.020772 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-3f3bb82a-2fe8-4893-9124-9e39a22c5723 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:51.027208 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3f3bb82a-2fe8-4893-9124-9e39a22c5723 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:51.027689 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3f3bb82a-2fe8-4893-9124-9e39a22c5723 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:51.028121 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3f3bb82a-2fe8-4893-9124-9e39a22c5723 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:51.028839 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3f3bb82a-2fe8-4893-9124-9e39a22c5723 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:51.030256 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3f3bb82a-2fe8-4893-9124-9e39a22c5723 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:51.030505 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3f3bb82a-2fe8-4893-9124-9e39a22c5723 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:51.159463 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-561fe210-4008-4d43-a027-b5b9011e9300 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:51.160082 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-561fe210-4008-4d43-a027-b5b9011e9300 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:51.166590 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-561fe210-4008-4d43-a027-b5b9011e9300 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:51.167085 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-561fe210-4008-4d43-a027-b5b9011e9300 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:51.167440 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3f3bb82a-2fe8-4893-9124-9e39a22c5723 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:51.167561 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-561fe210-4008-4d43-a027-b5b9011e9300 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:51.168250 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-561fe210-4008-4d43-a027-b5b9011e9300 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:51.168741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-561fe210-4008-4d43-a027-b5b9011e9300 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:51.169169 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-561fe210-4008-4d43-a027-b5b9011e9300 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:51.176129 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3f3bb82a-2fe8-4893-9124-9e39a22c5723 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:51.177846 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3f3bb82a-2fe8-4893-9124-9e39a22c5723 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:51.179065 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3f3bb82a-2fe8-4893-9124-9e39a22c5723 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1408 microversion: 2.20 time: 0.162815 Aug 05 20:11:51.179709 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 453/928] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:51 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:51.304047 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-561fe210-4008-4d43-a027-b5b9011e9300 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:51.312046 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-561fe210-4008-4d43-a027-b5b9011e9300 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.156426 Aug 05 20:11:51.312620 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 476/929] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:51 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:52.202692 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-4c9beec0-429e-44c9-955e-f01894863816 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:52.203302 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-4c9beec0-429e-44c9-955e-f01894863816 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:52.210016 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4c9beec0-429e-44c9-955e-f01894863816 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:52.210496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4c9beec0-429e-44c9-955e-f01894863816 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:52.210924 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4c9beec0-429e-44c9-955e-f01894863816 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:52.211617 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4c9beec0-429e-44c9-955e-f01894863816 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:52.212063 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4c9beec0-429e-44c9-955e-f01894863816 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:52.212487 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4c9beec0-429e-44c9-955e-f01894863816 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:52.337331 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-184fd839-3dca-487e-a0f3-b41981d66fa3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:52.338354 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-184fd839-3dca-487e-a0f3-b41981d66fa3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:52.364089 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-184fd839-3dca-487e-a0f3-b41981d66fa3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:52.364716 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-184fd839-3dca-487e-a0f3-b41981d66fa3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:52.365284 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-184fd839-3dca-487e-a0f3-b41981d66fa3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:52.366146 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-184fd839-3dca-487e-a0f3-b41981d66fa3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:52.366634 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-184fd839-3dca-487e-a0f3-b41981d66fa3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:52.367058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-184fd839-3dca-487e-a0f3-b41981d66fa3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:52.400699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-4c9beec0-429e-44c9-955e-f01894863816 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:52.413407 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-4c9beec0-429e-44c9-955e-f01894863816 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:52.414971 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-4c9beec0-429e-44c9-955e-f01894863816 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:52.416154 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-4c9beec0-429e-44c9-955e-f01894863816 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1408 microversion: 2.20 time: 0.218364 Aug 05 20:11:52.416943 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 454/930] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:52 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:52.532534 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-184fd839-3dca-487e-a0f3-b41981d66fa3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:52.540047 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-184fd839-3dca-487e-a0f3-b41981d66fa3 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.210091 Aug 05 20:11:52.540653 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 477/931] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:52 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:53.440723 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9e0ebf47-4e2c-45f9-ae69-a2cff9cc53a7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:53.441278 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-9e0ebf47-4e2c-45f9-ae69-a2cff9cc53a7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:53.447740 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9e0ebf47-4e2c-45f9-ae69-a2cff9cc53a7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:53.448225 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9e0ebf47-4e2c-45f9-ae69-a2cff9cc53a7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:53.448676 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9e0ebf47-4e2c-45f9-ae69-a2cff9cc53a7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:53.449364 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9e0ebf47-4e2c-45f9-ae69-a2cff9cc53a7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:53.449812 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9e0ebf47-4e2c-45f9-ae69-a2cff9cc53a7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:53.450280 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9e0ebf47-4e2c-45f9-ae69-a2cff9cc53a7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:53.561721 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-03f1db63-0ddf-43af-962c-7a886045ece8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:53.562615 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-03f1db63-0ddf-43af-962c-7a886045ece8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:53.569566 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-03f1db63-0ddf-43af-962c-7a886045ece8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:53.570059 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-03f1db63-0ddf-43af-962c-7a886045ece8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:53.570503 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-03f1db63-0ddf-43af-962c-7a886045ece8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:53.571516 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-03f1db63-0ddf-43af-962c-7a886045ece8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:53.571729 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-03f1db63-0ddf-43af-962c-7a886045ece8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:53.572138 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-03f1db63-0ddf-43af-962c-7a886045ece8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:53.586531 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9e0ebf47-4e2c-45f9-ae69-a2cff9cc53a7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:53.595247 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9e0ebf47-4e2c-45f9-ae69-a2cff9cc53a7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:53.596815 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9e0ebf47-4e2c-45f9-ae69-a2cff9cc53a7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:53.597943 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-9e0ebf47-4e2c-45f9-ae69-a2cff9cc53a7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1408 microversion: 2.20 time: 0.161303 Aug 05 20:11:53.598510 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 455/932] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:53 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:11:53.718929 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-03f1db63-0ddf-43af-962c-7a886045ece8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:53.727637 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-03f1db63-0ddf-43af-962c-7a886045ece8 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1522 microversion: 2.1 time: 0.170456 Aug 05 20:11:53.728295 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 478/933] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:53 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:11:54.253467 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-34d8e19a-6c0f-4682-8a3b-ac0483077efe req-23315c04-16a6-45ff-8d33-7e20c12a7783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaafcd0b-5f14-4973-8cc5-274510846bc2", "name": "network-vif-deleted", "tag": "ee1754c1-6ea5-469b-8697-519cd9b01157"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:54.263962 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-34d8e19a-6c0f-4682-8a3b-ac0483077efe req-23315c04-16a6-45ff-8d33-7e20c12a7783 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:54.264439 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-34d8e19a-6c0f-4682-8a3b-ac0483077efe req-23315c04-16a6-45ff-8d33-7e20c12a7783 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:54.265100 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-34d8e19a-6c0f-4682-8a3b-ac0483077efe req-23315c04-16a6-45ff-8d33-7e20c12a7783 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:54.277218 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-34d8e19a-6c0f-4682-8a3b-ac0483077efe req-23315c04-16a6-45ff-8d33-7e20c12a7783 service nova] Creating event network-vif-deleted:ee1754c1-6ea5-469b-8697-519cd9b01157 for instance eaafcd0b-5f14-4973-8cc5-274510846bc2 on hv-cinder-85221 Aug 05 20:11:54.283385 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-34d8e19a-6c0f-4682-8a3b-ac0483077efe req-23315c04-16a6-45ff-8d33-7e20c12a7783 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033784 Aug 05 20:11:54.283997 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 456/934] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:54.621340 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-f1533109-9321-4edf-83d2-3b1629295dc5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:54.621877 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-f1533109-9321-4edf-83d2-3b1629295dc5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:54.624799 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell0:SELECT=6 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:54.630530 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f1533109-9321-4edf-83d2-3b1629295dc5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:54.631024 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f1533109-9321-4edf-83d2-3b1629295dc5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:54.631464 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f1533109-9321-4edf-83d2-3b1629295dc5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:54.632170 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f1533109-9321-4edf-83d2-3b1629295dc5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:54.632656 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f1533109-9321-4edf-83d2-3b1629295dc5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:54.633085 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f1533109-9321-4edf-83d2-3b1629295dc5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:54.754613 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=2 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:54.755904 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=6 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:54.760088 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e4dd2672-cb4e-4032-a7ca-d44d95220c68 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:54.761828 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e4dd2672-cb4e-4032-a7ca-d44d95220c68 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:54.783535 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e4dd2672-cb4e-4032-a7ca-d44d95220c68 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:54.784039 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e4dd2672-cb4e-4032-a7ca-d44d95220c68 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:54.784766 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e4dd2672-cb4e-4032-a7ca-d44d95220c68 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:54.785726 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e4dd2672-cb4e-4032-a7ca-d44d95220c68 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:54.786423 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e4dd2672-cb4e-4032-a7ca-d44d95220c68 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:54.787104 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e4dd2672-cb4e-4032-a7ca-d44d95220c68 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:54.792151 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-f1533109-9321-4edf-83d2-3b1629295dc5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:54.798812 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:54.818504 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-f1533109-9321-4edf-83d2-3b1629295dc5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:54.820142 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-f1533109-9321-4edf-83d2-3b1629295dc5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:54.824252 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e4dd2672-cb4e-4032-a7ca-d44d95220c68 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:54.824693 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-f1533109-9321-4edf-83d2-3b1629295dc5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1408 microversion: 2.20 time: 0.204067 Aug 05 20:11:54.825260 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e4dd2672-cb4e-4032-a7ca-d44d95220c68 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:54.825386 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 479/935] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:54 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1408 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:54.826286 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e4dd2672-cb4e-4032-a7ca-d44d95220c68 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:54.827379 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.objects.instance [None req-e4dd2672-cb4e-4032-a7ca-d44d95220c68 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lazy-loading 'fault' on Instance uuid eaafcd0b-5f14-4973-8cc5-274510846bc2 {{(pid=118191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:11:54.896820 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e4dd2672-cb4e-4032-a7ca-d44d95220c68 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293b8a62f19c45c1bf5b897c7cf40edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b5718607784ec9be3289f7916f70a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:54.912221 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e4dd2672-cb4e-4032-a7ca-d44d95220c68 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 200 len: 1312 microversion: 2.1 time: 0.158437 Aug 05 20:11:54.925902 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 457/936] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:54 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 1312 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:11:55.849936 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-970d636e-b336-4c2e-b19d-9adde283dc88 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:55.850609 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-970d636e-b336-4c2e-b19d-9adde283dc88 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:55.861173 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-970d636e-b336-4c2e-b19d-9adde283dc88 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:55.862041 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-970d636e-b336-4c2e-b19d-9adde283dc88 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:55.862503 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-970d636e-b336-4c2e-b19d-9adde283dc88 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:55.863526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-970d636e-b336-4c2e-b19d-9adde283dc88 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:55.864016 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-970d636e-b336-4c2e-b19d-9adde283dc88 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:55.864446 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-970d636e-b336-4c2e-b19d-9adde283dc88 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:55.935125 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-bf7bc22b-6014-4307-a544-0a0d5b865a08 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:55.936417 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-bf7bc22b-6014-4307-a544-0a0d5b865a08 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] [instance: eaafcd0b-5f14-4973-8cc5-274510846bc2] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:55.943638 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bf7bc22b-6014-4307-a544-0a0d5b865a08 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:55.944436 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bf7bc22b-6014-4307-a544-0a0d5b865a08 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:55.944923 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bf7bc22b-6014-4307-a544-0a0d5b865a08 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:55.945918 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bf7bc22b-6014-4307-a544-0a0d5b865a08 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:55.946145 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bf7bc22b-6014-4307-a544-0a0d5b865a08 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:55.946585 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bf7bc22b-6014-4307-a544-0a0d5b865a08 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:55.965040 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-bf7bc22b-6014-4307-a544-0a0d5b865a08 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] HTTP exception thrown: Instance eaafcd0b-5f14-4973-8cc5-274510846bc2 could not be found. Aug 05 20:11:55.967550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-bf7bc22b-6014-4307-a544-0a0d5b865a08 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Request method failure captured: Aug 05 20:11:55.967550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 HTTP/1.1 Aug 05 20:11:55.967550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:11:55.967550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:11:55.967550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:11:55.967550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:11:55.967550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:11:55.967550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:11:55.967550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:11:55.967550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:11:55.967550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XdnvYt02KSUfuGZ4aMCLRd8A9W_4ugESxync32oagoq2m1bRquV2YcYbZy923ze2HKyg5orLp5ZPgQwQNpL1ZwXjKJN6rbHklb_4GvGBhZZEq-4iAyROqoLvdfOlApZwfRc8nLpUC3uM58ekKbcVuoIhI3WM4aUZiobfffRTVMm8jY Aug 05 20:11:55.967550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:11:55.967550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:11:55.967550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:11:55.967550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:11:55.967550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:11:55.967550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:11:55.967550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: c5b5718607784ec9be3289f7916f70a6 Aug 05 20:11:55.967550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1357645261 Aug 05 20:11:55.967550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:11:55.967550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:11:55.969157 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c5b5718607784ec9be3289f7916f70a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c5b5718607784ec9be3289f7916f70a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c5b5718607784ec9be3289f7916f70a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c5b5718607784ec9be3289f7916f70a6", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:11:55.969157 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1357645261 Aug 05 20:11:55.969157 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: c5b5718607784ec9be3289f7916f70a6 Aug 05 20:11:55.969157 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1357645261 Aug 05 20:11:55.969157 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-ServerRescueNegativeTestJSON-1357645261-project Aug 05 20:11:55.969157 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:11:55.969157 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:11:55.969157 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: 293b8a62f19c45c1bf5b897c7cf40edb Aug 05 20:11:55.969157 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1357645261-project Aug 05 20:11:55.969157 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: > Aug 05 20:11:55.969157 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Instance eaafcd0b-5f14-4973-8cc5-274510846bc2 could not be found. Aug 05 20:11:55.969157 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'id': 'eaafcd0b-5f14-4973-8cc5-274510846bc2'} Aug 05 20:11:55.969981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:11:55.969981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:11:55.969981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:11:55.969981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:11:55.969981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:11:55.969981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:11:55.969981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:11:55.969981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:11:55.969981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:11:55.969981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:11:55.969981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaafcd0b-5f14-4973-8cc5-274510846bc2 could not be found. Aug 05 20:11:55.969981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:11:55.969981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:11:55.969981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:11:55.969981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:11:55.969981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:11:55.969981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:11:55.969981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:11:55.969981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:11:55.969981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:11:55.971695 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:11:55.971695 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:11:55.971695 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:11:55.971695 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:11:55.971695 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:11:55.971695 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:11:55.971695 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:11:55.971695 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaafcd0b-5f14-4973-8cc5-274510846bc2 could not be found. Aug 05 20:11:55.971695 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:11:55.971695 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:11:55.971695 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:11:55.971695 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:11:55.971695 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:11:55.971695 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:11:55.971695 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:11:55.971695 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:11:55.971695 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaafcd0b-5f14-4973-8cc5-274510846bc2 could not be found. Aug 05 20:11:55.971695 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:11:55.973914 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-bf7bc22b-6014-4307-a544-0a0d5b865a08 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] Returning 404 to user: Instance eaafcd0b-5f14-4973-8cc5-274510846bc2 could not be found. {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:11:55.973914 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-bf7bc22b-6014-4307-a544-0a0d5b865a08 tempest-ServerRescueNegativeTestJSON-1357645261 tempest-ServerRescueNegativeTestJSON-1357645261-project] 10.222.0.39 "GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2" status: 404 len: 111 microversion: 2.1 time: 0.038653 Aug 05 20:11:55.973914 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 458/937] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:11:55 2022] GET /compute/v2.1/servers/eaafcd0b-5f14-4973-8cc5-274510846bc2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 20:11:56.020825 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-970d636e-b336-4c2e-b19d-9adde283dc88 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:56.034878 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-970d636e-b336-4c2e-b19d-9adde283dc88 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:56.038044 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-970d636e-b336-4c2e-b19d-9adde283dc88 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:56.039978 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-970d636e-b336-4c2e-b19d-9adde283dc88 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1408 microversion: 2.20 time: 0.193804 Aug 05 20:11:56.040930 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 480/938] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:55 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1408 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:11:56.363036 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-ca7e6d88-339c-4bb8-9679-823f55bd1a9f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1944932153"}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:56.363852 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-ca7e6d88-339c-4bb8-9679-823f55bd1a9f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:56.369958 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ca7e6d88-339c-4bb8-9679-823f55bd1a9f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:56.370446 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ca7e6d88-339c-4bb8-9679-823f55bd1a9f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:56.370879 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ca7e6d88-339c-4bb8-9679-823f55bd1a9f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:56.371578 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ca7e6d88-339c-4bb8-9679-823f55bd1a9f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:56.372024 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ca7e6d88-339c-4bb8-9679-823f55bd1a9f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:56.372444 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ca7e6d88-339c-4bb8-9679-823f55bd1a9f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:56.515081 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.network.security_group_api [None req-ca7e6d88-339c-4bb8-9679-823f55bd1a9f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Removing security group 23ad4f90-c228-4466-9200-3e3e9a8e73eb from port 543b6e01-d59d-496a-ba4f-c4f68f78dad4 Aug 05 20:11:56.859184 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-ca7e6d88-339c-4bb8-9679-823f55bd1a9f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "POST /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760/action" status: 202 len: 0 microversion: 2.1 time: 0.499879 Aug 05 20:11:56.862730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 459/939] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Aug 5 20:11:56 2022] POST /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:11:56.874286 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-ec37feec-332e-4631-ac4a-ecd29574d577 req-1c72035e-3a94-4747-a1c4-ea9dda031247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9a46a51-71f3-4aa6-ab85-c4d514de3760", "tag": "543b6e01-d59d-496a-ba4f-c4f68f78dad4"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:56.894838 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-ec37feec-332e-4631-ac4a-ecd29574d577 req-1c72035e-3a94-4747-a1c4-ea9dda031247 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:56.895960 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-ec37feec-332e-4631-ac4a-ecd29574d577 req-1c72035e-3a94-4747-a1c4-ea9dda031247 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:56.897031 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-ec37feec-332e-4631-ac4a-ecd29574d577 req-1c72035e-3a94-4747-a1c4-ea9dda031247 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:56.918123 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-ec37feec-332e-4631-ac4a-ecd29574d577 req-1c72035e-3a94-4747-a1c4-ea9dda031247 service nova] Creating event network-changed:543b6e01-d59d-496a-ba4f-c4f68f78dad4 for instance a9a46a51-71f3-4aa6-ab85-c4d514de3760 on hv-cinder-85221 Aug 05 20:11:56.927723 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-ec37feec-332e-4631-ac4a-ecd29574d577 req-1c72035e-3a94-4747-a1c4-ea9dda031247 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054083 Aug 05 20:11:56.930570 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 481/940] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:11:57.066788 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-08518a52-86d1-48b1-aab3-14f77ff67c95 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:57.067486 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-08518a52-86d1-48b1-aab3-14f77ff67c95 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:57.076852 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-08518a52-86d1-48b1-aab3-14f77ff67c95 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:57.077465 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-08518a52-86d1-48b1-aab3-14f77ff67c95 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:57.077981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-08518a52-86d1-48b1-aab3-14f77ff67c95 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:57.078970 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-08518a52-86d1-48b1-aab3-14f77ff67c95 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:57.079689 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-08518a52-86d1-48b1-aab3-14f77ff67c95 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:57.080678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-08518a52-86d1-48b1-aab3-14f77ff67c95 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:57.359371 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-08518a52-86d1-48b1-aab3-14f77ff67c95 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:57.378132 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-08518a52-86d1-48b1-aab3-14f77ff67c95 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:57.391797 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-08518a52-86d1-48b1-aab3-14f77ff67c95 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:57.394471 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-08518a52-86d1-48b1-aab3-14f77ff67c95 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1408 microversion: 2.20 time: 0.333286 Aug 05 20:11:57.396059 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 460/941] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:57 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1408 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:57.515432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-ebaf2e4d-68be-4b2f-9ec2-c8ab8df781c7 req-f002d8fc-ed72-4b25-942b-b1d65898fe66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4869087-6b2c-466b-beb3-36ad64c5d5eb", "name": "network-vif-plugged", "status": "completed", "tag": "13a23b2f-953f-46e0-b2af-1d2023dbbe54"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:57.531509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-ebaf2e4d-68be-4b2f-9ec2-c8ab8df781c7 req-f002d8fc-ed72-4b25-942b-b1d65898fe66 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:57.533555 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-ebaf2e4d-68be-4b2f-9ec2-c8ab8df781c7 req-f002d8fc-ed72-4b25-942b-b1d65898fe66 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:57.534926 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-ebaf2e4d-68be-4b2f-9ec2-c8ab8df781c7 req-f002d8fc-ed72-4b25-942b-b1d65898fe66 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:57.550786 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-ebaf2e4d-68be-4b2f-9ec2-c8ab8df781c7 req-f002d8fc-ed72-4b25-942b-b1d65898fe66 service nova] Creating event network-vif-plugged:13a23b2f-953f-46e0-b2af-1d2023dbbe54 for instance e4869087-6b2c-466b-beb3-36ad64c5d5eb on hv-cinder-85221 Aug 05 20:11:57.557435 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-ebaf2e4d-68be-4b2f-9ec2-c8ab8df781c7 req-f002d8fc-ed72-4b25-942b-b1d65898fe66 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047531 Aug 05 20:11:57.558710 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 482/942] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:58.422781 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-d2a35af9-08f6-4e28-b390-79e35a062b8d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:58.424231 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-d2a35af9-08f6-4e28-b390-79e35a062b8d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:58.432048 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d2a35af9-08f6-4e28-b390-79e35a062b8d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:58.433013 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d2a35af9-08f6-4e28-b390-79e35a062b8d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:58.433692 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d2a35af9-08f6-4e28-b390-79e35a062b8d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:58.434665 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d2a35af9-08f6-4e28-b390-79e35a062b8d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:58.435520 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d2a35af9-08f6-4e28-b390-79e35a062b8d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:58.436680 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d2a35af9-08f6-4e28-b390-79e35a062b8d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:58.441668 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=100 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:11:59.062926 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-d2a35af9-08f6-4e28-b390-79e35a062b8d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:59.076956 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-d2a35af9-08f6-4e28-b390-79e35a062b8d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:59.078485 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-d2a35af9-08f6-4e28-b390-79e35a062b8d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:11:59.079700 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-d2a35af9-08f6-4e28-b390-79e35a062b8d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1408 microversion: 2.20 time: 0.662205 Aug 05 20:11:59.080270 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 461/943] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:11:58 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1408 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:11:59.255137 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-db800adc-374a-4cbe-b929-16c637c8756a req-0ddd4258-e513-42b7-ac96-2cf8315affd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9a46a51-71f3-4aa6-ab85-c4d514de3760", "tag": "543b6e01-d59d-496a-ba4f-c4f68f78dad4"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:11:59.262219 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-8f9065ea-a558-4bba-a970-2a6662b40458 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:59.262931 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-8f9065ea-a558-4bba-a970-2a6662b40458 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:59.270533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-db800adc-374a-4cbe-b929-16c637c8756a req-0ddd4258-e513-42b7-ac96-2cf8315affd9 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:59.271361 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-db800adc-374a-4cbe-b929-16c637c8756a req-0ddd4258-e513-42b7-ac96-2cf8315affd9 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:59.272048 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-db800adc-374a-4cbe-b929-16c637c8756a req-0ddd4258-e513-42b7-ac96-2cf8315affd9 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:59.274809 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8f9065ea-a558-4bba-a970-2a6662b40458 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:59.275642 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8f9065ea-a558-4bba-a970-2a6662b40458 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:59.282324 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8f9065ea-a558-4bba-a970-2a6662b40458 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:59.285048 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8f9065ea-a558-4bba-a970-2a6662b40458 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:59.285514 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-db800adc-374a-4cbe-b929-16c637c8756a req-0ddd4258-e513-42b7-ac96-2cf8315affd9 service nova] Creating event network-changed:543b6e01-d59d-496a-ba4f-c4f68f78dad4 for instance a9a46a51-71f3-4aa6-ab85-c4d514de3760 on hv-cinder-85221 Aug 05 20:11:59.286130 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8f9065ea-a558-4bba-a970-2a6662b40458 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:59.287375 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8f9065ea-a558-4bba-a970-2a6662b40458 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:59.291587 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-db800adc-374a-4cbe-b929-16c637c8756a req-0ddd4258-e513-42b7-ac96-2cf8315affd9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040279 Aug 05 20:11:59.293049 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 462/944] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:11:59.425646 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.objects.instance [None req-8f9065ea-a558-4bba-a970-2a6662b40458 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lazy-loading 'services' on Instance uuid a9a46a51-71f3-4aa6-ab85-c4d514de3760 {{(pid=118192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:11:59.588037 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-8f9065ea-a558-4bba-a970-2a6662b40458 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760/os-volume_attachments/3d8cf1aa-110d-434a-8f2c-48c1f4a048de" status: 202 len: 0 microversion: 2.1 time: 0.346202 Aug 05 20:11:59.593160 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 483/945] 10.222.0.39 () {58 vars in 1416 bytes} [Fri Aug 5 20:11:59 2022] DELETE /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760/os-volume_attachments/3d8cf1aa-110d-434a-8f2c-48c1f4a048de => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:11:59.598953 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-727a1f3f-5f8d-4b58-964c-a6619cecdb59 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:11:59.601459 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-727a1f3f-5f8d-4b58-964c-a6619cecdb59 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:11:59.614215 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-727a1f3f-5f8d-4b58-964c-a6619cecdb59 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:59.615182 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-727a1f3f-5f8d-4b58-964c-a6619cecdb59 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:59.615634 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-727a1f3f-5f8d-4b58-964c-a6619cecdb59 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:59.616376 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-727a1f3f-5f8d-4b58-964c-a6619cecdb59 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:11:59.616862 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-727a1f3f-5f8d-4b58-964c-a6619cecdb59 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:11:59.617289 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-727a1f3f-5f8d-4b58-964c-a6619cecdb59 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:11:59.677389 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-727a1f3f-5f8d-4b58-964c-a6619cecdb59 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083486 Aug 05 20:11:59.678219 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 463/946] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Aug 5 20:11:59 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:12:00.105259 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-56a37a9d-8ae9-4519-abd7-5f7e8be97cbc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:00.106131 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-56a37a9d-8ae9-4519-abd7-5f7e8be97cbc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:00.121463 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-56a37a9d-8ae9-4519-abd7-5f7e8be97cbc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:00.122153 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-56a37a9d-8ae9-4519-abd7-5f7e8be97cbc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:00.123723 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-56a37a9d-8ae9-4519-abd7-5f7e8be97cbc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:00.123723 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-56a37a9d-8ae9-4519-abd7-5f7e8be97cbc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:00.124679 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-56a37a9d-8ae9-4519-abd7-5f7e8be97cbc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:00.125396 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-56a37a9d-8ae9-4519-abd7-5f7e8be97cbc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:00.362315 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-56a37a9d-8ae9-4519-abd7-5f7e8be97cbc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:00.373233 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-56a37a9d-8ae9-4519-abd7-5f7e8be97cbc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:00.375363 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-56a37a9d-8ae9-4519-abd7-5f7e8be97cbc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:00.376622 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-56a37a9d-8ae9-4519-abd7-5f7e8be97cbc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1600 microversion: 2.20 time: 0.276816 Aug 05 20:12:00.377195 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 484/947] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:12:00 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1600 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:12:00.400058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-1dacd523-885a-4a29-b666-a5d4cfa8ea3f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:00.400864 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-1dacd523-885a-4a29-b666-a5d4cfa8ea3f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:00.421718 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1dacd523-885a-4a29-b666-a5d4cfa8ea3f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:00.429190 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1dacd523-885a-4a29-b666-a5d4cfa8ea3f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:00.430134 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1dacd523-885a-4a29-b666-a5d4cfa8ea3f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:00.431180 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1dacd523-885a-4a29-b666-a5d4cfa8ea3f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:00.431660 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1dacd523-885a-4a29-b666-a5d4cfa8ea3f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:00.432090 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1dacd523-885a-4a29-b666-a5d4cfa8ea3f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:00.597962 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-1dacd523-885a-4a29-b666-a5d4cfa8ea3f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.201979 Aug 05 20:12:00.605966 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 464/948] 10.222.0.39 () {60 vars in 1316 bytes} [Fri Aug 5 20:12:00 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb/os-interface => generated 284 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:12:00.690724 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ba4240ff-7c71-4806-af2b-ac0c6790ed9e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:00.694152 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-ba4240ff-7c71-4806-af2b-ac0c6790ed9e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:00.701877 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ba4240ff-7c71-4806-af2b-ac0c6790ed9e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:00.702717 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ba4240ff-7c71-4806-af2b-ac0c6790ed9e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:00.703383 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ba4240ff-7c71-4806-af2b-ac0c6790ed9e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:00.704341 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ba4240ff-7c71-4806-af2b-ac0c6790ed9e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:00.705058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ba4240ff-7c71-4806-af2b-ac0c6790ed9e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:00.705724 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ba4240ff-7c71-4806-af2b-ac0c6790ed9e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:00.762778 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-ba4240ff-7c71-4806-af2b-ac0c6790ed9e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075736 Aug 05 20:12:00.764236 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 485/949] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Aug 5 20:12:00 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:12:01.776365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-2d7417b2-4cab-4d77-8c94-098181875eb3 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:01.779909 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-2d7417b2-4cab-4d77-8c94-098181875eb3 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:01.789652 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2d7417b2-4cab-4d77-8c94-098181875eb3 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:01.790178 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2d7417b2-4cab-4d77-8c94-098181875eb3 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:01.790836 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2d7417b2-4cab-4d77-8c94-098181875eb3 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:01.791607 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2d7417b2-4cab-4d77-8c94-098181875eb3 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:01.792315 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2d7417b2-4cab-4d77-8c94-098181875eb3 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:01.792975 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2d7417b2-4cab-4d77-8c94-098181875eb3 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:01.828261 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-2d7417b2-4cab-4d77-8c94-098181875eb3 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055240 Aug 05 20:12:01.828261 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 465/950] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Aug 5 20:12:01 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:12:01.839975 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-374ed24c-4f5d-472f-8f2b-7f3e958e7b3f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:01.840675 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-374ed24c-4f5d-472f-8f2b-7f3e958e7b3f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:01.848821 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-374ed24c-4f5d-472f-8f2b-7f3e958e7b3f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:01.849517 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-374ed24c-4f5d-472f-8f2b-7f3e958e7b3f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:01.849963 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-374ed24c-4f5d-472f-8f2b-7f3e958e7b3f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:01.851550 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-374ed24c-4f5d-472f-8f2b-7f3e958e7b3f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:01.851550 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-374ed24c-4f5d-472f-8f2b-7f3e958e7b3f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:01.851855 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-374ed24c-4f5d-472f-8f2b-7f3e958e7b3f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:01.939938 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-374ed24c-4f5d-472f-8f2b-7f3e958e7b3f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] HTTP exception thrown: Instance a9a46a51-71f3-4aa6-ab85-c4d514de3760 is not attached to volume 3d8cf1aa-110d-434a-8f2c-48c1f4a048de Aug 05 20:12:01.948201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-374ed24c-4f5d-472f-8f2b-7f3e958e7b3f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Request method failure captured: Aug 05 20:12:01.948201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: DELETE /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760/os-volume_attachments/3d8cf1aa-110d-434a-8f2c-48c1f4a048de HTTP/1.1 Aug 05 20:12:01.948201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:12:01.948201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:12:01.948201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:12:01.948201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 0 Aug 05 20:12:01.948201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:12:01.948201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:12:01.948201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:12:01.948201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:12:01.948201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7Xh7qy3UbbieGE7Q3bNeBCOAKHmgmR0jS8zPIO4JRJ6EZGExLSkcaWKIW1fiO2vDOHKEVPLc4ncXLjG5fB4axx1SK7YRzaB1nOzjYsT3IlC3AimGGNWpszaxYhcwFAg_5WxolX2-eLZA5VcjaAJoph224PWWI_6zo4gBCAc9IMQ-1R8 Aug 05 20:12:01.948201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:12:01.948201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:12:01.948201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:12:01.948201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:12:01.948201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:12:01.948201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:12:01.948201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: fe26e033d1844e28849ed4de857a7958 Aug 05 20:12:01.948201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-TestMinimumBasicScenario-1680758824 Aug 05 20:12:01.948201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:12:01.948201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:12:01.949731 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fe26e033d1844e28849ed4de857a7958"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fe26e033d1844e28849ed4de857a7958"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fe26e033d1844e28849ed4de857a7958"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fe26e033d1844e28849ed4de857a7958", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:12:01.949731 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-TestMinimumBasicScenario-1680758824 Aug 05 20:12:01.949731 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: fe26e033d1844e28849ed4de857a7958 Aug 05 20:12:01.949731 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1680758824 Aug 05 20:12:01.949731 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-TestMinimumBasicScenario-1680758824-project Aug 05 20:12:01.949731 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:12:01.949731 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:12:01.949731 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: 368838695ea74570b7e30c17a211b82b Aug 05 20:12:01.949731 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-TestMinimumBasicScenario-1680758824-project Aug 05 20:12:01.949731 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: > Aug 05 20:12:01.949731 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Instance a9a46a51-71f3-4aa6-ab85-c4d514de3760 is not attached to volume 3d8cf1aa-110d-434a-8f2c-48c1f4a048de Aug 05 20:12:01.950471 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'server_id': 'a9a46a51-71f3-4aa6-ab85-c4d514de3760', 'id': '3d8cf1aa-110d-434a-8f2c-48c1f4a048de'} Aug 05 20:12:01.950471 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:12:01.950471 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:01.950471 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 05 20:12:01.950471 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 05 20:12:01.950471 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 20:12:01.950471 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 20:12:01.950471 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 05 20:12:01.950471 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 05 20:12:01.950471 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3d8cf1aa-110d-434a-8f2c-48c1f4a048de. Aug 05 20:12:01.950471 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:12:01.950471 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:01.950471 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:12:01.950471 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:01.950471 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:01.950471 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:01.950471 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:12:01.950471 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:12:01.950471 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:12:01.952312 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:12:01.952312 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 05 20:12:01.952312 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 05 20:12:01.952312 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9a46a51-71f3-4aa6-ab85-c4d514de3760 is not attached to volume 3d8cf1aa-110d-434a-8f2c-48c1f4a048de Aug 05 20:12:01.952312 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:12:01.952312 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:01.952312 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:12:01.952312 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:01.952312 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:01.952312 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:01.952312 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:12:01.952312 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:12:01.952312 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9a46a51-71f3-4aa6-ab85-c4d514de3760 is not attached to volume 3d8cf1aa-110d-434a-8f2c-48c1f4a048de Aug 05 20:12:01.952312 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:12:01.952312 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-374ed24c-4f5d-472f-8f2b-7f3e958e7b3f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Returning 404 to user: Instance a9a46a51-71f3-4aa6-ab85-c4d514de3760 is not attached to volume 3d8cf1aa-110d-434a-8f2c-48c1f4a048de {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:12:01.953933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-374ed24c-4f5d-472f-8f2b-7f3e958e7b3f tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760/os-volume_attachments/3d8cf1aa-110d-434a-8f2c-48c1f4a048de" status: 404 len: 154 microversion: 2.1 time: 0.115726 Aug 05 20:12:01.953933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 486/951] 10.222.0.39 () {58 vars in 1416 bytes} [Fri Aug 5 20:12:01 2022] DELETE /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760/os-volume_attachments/3d8cf1aa-110d-434a-8f2c-48c1f4a048de => generated 154 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:12:02.013009 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-9108ebf0-f69f-4b34-b4a8-0523360dd158 req-d9643ec1-6828-4c02-8a08-6b819b66dc14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4869087-6b2c-466b-beb3-36ad64c5d5eb", "tag": "13a23b2f-953f-46e0-b2af-1d2023dbbe54"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:12:02.037123 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-9108ebf0-f69f-4b34-b4a8-0523360dd158 req-d9643ec1-6828-4c02-8a08-6b819b66dc14 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:02.037873 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-9108ebf0-f69f-4b34-b4a8-0523360dd158 req-d9643ec1-6828-4c02-8a08-6b819b66dc14 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:02.038573 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-9108ebf0-f69f-4b34-b4a8-0523360dd158 req-d9643ec1-6828-4c02-8a08-6b819b66dc14 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:02.061374 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-9108ebf0-f69f-4b34-b4a8-0523360dd158 req-d9643ec1-6828-4c02-8a08-6b819b66dc14 service nova] Creating event network-changed:13a23b2f-953f-46e0-b2af-1d2023dbbe54 for instance e4869087-6b2c-466b-beb3-36ad64c5d5eb on hv-cinder-85221 Aug 05 20:12:02.069067 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-9108ebf0-f69f-4b34-b4a8-0523360dd158 req-d9643ec1-6828-4c02-8a08-6b819b66dc14 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059887 Aug 05 20:12:02.073380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 466/952] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:12:03.176320 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-48d7ce9f-1a5b-499a-894d-2339182ba971 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:03.177080 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-48d7ce9f-1a5b-499a-894d-2339182ba971 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:03.184909 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-48d7ce9f-1a5b-499a-894d-2339182ba971 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:03.185875 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-48d7ce9f-1a5b-499a-894d-2339182ba971 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:03.187341 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-48d7ce9f-1a5b-499a-894d-2339182ba971 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:03.188342 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-48d7ce9f-1a5b-499a-894d-2339182ba971 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:03.189324 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-48d7ce9f-1a5b-499a-894d-2339182ba971 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:03.189982 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-48d7ce9f-1a5b-499a-894d-2339182ba971 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:03.221214 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-48d7ce9f-1a5b-499a-894d-2339182ba971 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Going to try to terminate instance {{(pid=118192) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:12:03.375338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:03.380067 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-48d7ce9f-1a5b-499a-894d-2339182ba971 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 204 len: 0 microversion: 2.1 time: 0.207533 Aug 05 20:12:03.381293 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 487/953] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:12:03 2022] DELETE /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:12:03.391893 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f9facf5b-f805-4b52-b5b8-429ae22bcf6e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:03.392676 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f9facf5b-f805-4b52-b5b8-429ae22bcf6e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:03.400489 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f9facf5b-f805-4b52-b5b8-429ae22bcf6e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:03.401293 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f9facf5b-f805-4b52-b5b8-429ae22bcf6e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:03.401956 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f9facf5b-f805-4b52-b5b8-429ae22bcf6e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:03.402920 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f9facf5b-f805-4b52-b5b8-429ae22bcf6e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:03.403621 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f9facf5b-f805-4b52-b5b8-429ae22bcf6e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:03.404877 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f9facf5b-f805-4b52-b5b8-429ae22bcf6e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:03.833729 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f9facf5b-f805-4b52-b5b8-429ae22bcf6e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:03.842181 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f9facf5b-f805-4b52-b5b8-429ae22bcf6e tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1554 microversion: 2.1 time: 0.456135 Aug 05 20:12:03.842889 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 467/954] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:03 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1554 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:04.865526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-558a2e5f-600c-4f24-9326-e5f120f4ff93 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:04.866245 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-558a2e5f-600c-4f24-9326-e5f120f4ff93 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:04.875146 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-558a2e5f-600c-4f24-9326-e5f120f4ff93 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:04.875925 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-558a2e5f-600c-4f24-9326-e5f120f4ff93 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:04.876568 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-558a2e5f-600c-4f24-9326-e5f120f4ff93 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:04.877599 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-558a2e5f-600c-4f24-9326-e5f120f4ff93 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:04.878430 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-558a2e5f-600c-4f24-9326-e5f120f4ff93 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:04.879504 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-558a2e5f-600c-4f24-9326-e5f120f4ff93 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:05.340751 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-558a2e5f-600c-4f24-9326-e5f120f4ff93 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:05.356546 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-558a2e5f-600c-4f24-9326-e5f120f4ff93 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1554 microversion: 2.1 time: 0.495309 Aug 05 20:12:05.358748 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 488/955] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:04 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1554 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:06.385107 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-cc8c0119-93b6-47d9-88d4-ebfadda1dafa tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:06.387220 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-cc8c0119-93b6-47d9-88d4-ebfadda1dafa tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:06.399383 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cc8c0119-93b6-47d9-88d4-ebfadda1dafa tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:06.400150 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cc8c0119-93b6-47d9-88d4-ebfadda1dafa tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:06.401189 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cc8c0119-93b6-47d9-88d4-ebfadda1dafa tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:06.402140 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cc8c0119-93b6-47d9-88d4-ebfadda1dafa tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:06.402600 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cc8c0119-93b6-47d9-88d4-ebfadda1dafa tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:06.403020 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cc8c0119-93b6-47d9-88d4-ebfadda1dafa tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:06.776808 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-cc8c0119-93b6-47d9-88d4-ebfadda1dafa tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:06.787691 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-cc8c0119-93b6-47d9-88d4-ebfadda1dafa tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1554 microversion: 2.1 time: 0.411481 Aug 05 20:12:06.789512 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 468/956] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:06 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1554 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:07.313640 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-4d9720c9-4f26-4f52-9c7f-c45310e25d61 req-cad4a4a7-6eff-42a7-8497-1ae1728f4ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a46a51-71f3-4aa6-ab85-c4d514de3760", "name": "network-vif-deleted", "tag": "543b6e01-d59d-496a-ba4f-c4f68f78dad4"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:12:07.338955 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-4d9720c9-4f26-4f52-9c7f-c45310e25d61 req-cad4a4a7-6eff-42a7-8497-1ae1728f4ce6 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:07.339445 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-4d9720c9-4f26-4f52-9c7f-c45310e25d61 req-cad4a4a7-6eff-42a7-8497-1ae1728f4ce6 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:07.339871 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-4d9720c9-4f26-4f52-9c7f-c45310e25d61 req-cad4a4a7-6eff-42a7-8497-1ae1728f4ce6 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:07.357302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-4d9720c9-4f26-4f52-9c7f-c45310e25d61 req-cad4a4a7-6eff-42a7-8497-1ae1728f4ce6 service nova] Creating event network-vif-deleted:543b6e01-d59d-496a-ba4f-c4f68f78dad4 for instance a9a46a51-71f3-4aa6-ab85-c4d514de3760 on hv-cinder-85221 Aug 05 20:12:07.365013 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-4d9720c9-4f26-4f52-9c7f-c45310e25d61 req-cad4a4a7-6eff-42a7-8497-1ae1728f4ce6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056455 Aug 05 20:12:07.365848 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 489/957] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:12:07.812241 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-e375a81c-39a0-4e78-a15c-0cb314308e56 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:07.813174 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-e375a81c-39a0-4e78-a15c-0cb314308e56 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:07.819987 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e375a81c-39a0-4e78-a15c-0cb314308e56 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:07.820806 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e375a81c-39a0-4e78-a15c-0cb314308e56 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:07.821444 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e375a81c-39a0-4e78-a15c-0cb314308e56 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:07.822356 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e375a81c-39a0-4e78-a15c-0cb314308e56 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:07.822823 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e375a81c-39a0-4e78-a15c-0cb314308e56 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:07.823259 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e375a81c-39a0-4e78-a15c-0cb314308e56 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:07.862500 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e375a81c-39a0-4e78-a15c-0cb314308e56 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:07.863055 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e375a81c-39a0-4e78-a15c-0cb314308e56 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:07.863433 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e375a81c-39a0-4e78-a15c-0cb314308e56 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:07.863899 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.objects.instance [None req-e375a81c-39a0-4e78-a15c-0cb314308e56 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lazy-loading 'fault' on Instance uuid a9a46a51-71f3-4aa6-ab85-c4d514de3760 {{(pid=118192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:12:07.902866 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-5c1d4939-6ed4-4fc2-a74b-438f7ada15c0 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Action: 'create', calling method: .version_select at 0x7fe3e45b24c0>, body: {"keypair": {"name": "tempest-keypair-767842823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNH7InIWrMc7SP6hJRPJdJHbBYDCIjOl2yUwggGLf+umwQeSxDB/Qc1wUodHJJ5OH6UBWDF2AcGn3drP8pXQzfShVyfNALj2RwuV1GxXe2lvTeUgqt1lahVdy4anfQTE3w=="}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:12:07.921519 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-5c1d4939-6ed4-4fc2-a74b-438f7ada15c0 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Getting quotas for project 790b5019b9114120a51718d99317f7a1. Resources: {'key_pairs'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:12:07.924742 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-e375a81c-39a0-4e78-a15c-0cb314308e56 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368838695ea74570b7e30c17a211b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe26e033d1844e28849ed4de857a7958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:07.927435 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-5c1d4939-6ed4-4fc2-a74b-438f7ada15c0 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Getting quotas for user 305d1ce79a4f43c8b98e0967dab43da1 and project 790b5019b9114120a51718d99317f7a1. Resources: {'key_pairs'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:12:07.933777 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-e375a81c-39a0-4e78-a15c-0cb314308e56 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 200 len: 1348 microversion: 2.1 time: 0.125831 Aug 05 20:12:07.935655 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 490/958] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:07 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 1348 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:12:07.961299 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-5c1d4939-6ed4-4fc2-a74b-438f7ada15c0 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.221000 Aug 05 20:12:07.962059 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 469/959] 10.222.0.39 () {60 vars in 1159 bytes} [Fri Aug 5 20:12:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:12:08.955673 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-fa6fb4b9-ad85-4a92-a300-d4b243254398 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:08.957056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-fa6fb4b9-ad85-4a92-a300-d4b243254398 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] [instance: a9a46a51-71f3-4aa6-ab85-c4d514de3760] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:08.963647 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fa6fb4b9-ad85-4a92-a300-d4b243254398 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:08.964139 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fa6fb4b9-ad85-4a92-a300-d4b243254398 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:08.964592 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fa6fb4b9-ad85-4a92-a300-d4b243254398 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:08.965296 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fa6fb4b9-ad85-4a92-a300-d4b243254398 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:08.965748 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fa6fb4b9-ad85-4a92-a300-d4b243254398 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:08.966168 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fa6fb4b9-ad85-4a92-a300-d4b243254398 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:08.983263 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-fa6fb4b9-ad85-4a92-a300-d4b243254398 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] HTTP exception thrown: Instance a9a46a51-71f3-4aa6-ab85-c4d514de3760 could not be found. Aug 05 20:12:08.984948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-fa6fb4b9-ad85-4a92-a300-d4b243254398 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Request method failure captured: Aug 05 20:12:08.984948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 HTTP/1.1 Aug 05 20:12:08.984948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:12:08.984948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:12:08.984948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:12:08.984948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 0 Aug 05 20:12:08.984948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:12:08.984948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:12:08.984948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:12:08.984948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:12:08.984948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7Xh7qy3UbbieGE7Q3bNeBCOAKHmgmR0jS8zPIO4JRJ6EZGExLSkcaWKIW1fiO2vDOHKEVPLc4ncXLjG5fB4axx1SK7YRzaB1nOzjYsT3IlC3AimGGNWpszaxYhcwFAg_5WxolX2-eLZA5VcjaAJoph224PWWI_6zo4gBCAc9IMQ-1R8 Aug 05 20:12:08.984948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:12:08.984948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:12:08.984948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:12:08.984948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:12:08.984948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:12:08.984948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:12:08.984948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: fe26e033d1844e28849ed4de857a7958 Aug 05 20:12:08.984948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-TestMinimumBasicScenario-1680758824 Aug 05 20:12:08.984948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:12:08.984948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:12:08.986488 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fe26e033d1844e28849ed4de857a7958"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fe26e033d1844e28849ed4de857a7958"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fe26e033d1844e28849ed4de857a7958"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fe26e033d1844e28849ed4de857a7958", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:12:08.986488 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-TestMinimumBasicScenario-1680758824 Aug 05 20:12:08.986488 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: fe26e033d1844e28849ed4de857a7958 Aug 05 20:12:08.986488 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1680758824 Aug 05 20:12:08.986488 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-TestMinimumBasicScenario-1680758824-project Aug 05 20:12:08.986488 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:12:08.986488 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:12:08.986488 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: 368838695ea74570b7e30c17a211b82b Aug 05 20:12:08.986488 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-TestMinimumBasicScenario-1680758824-project Aug 05 20:12:08.986488 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: > Aug 05 20:12:08.986488 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Instance a9a46a51-71f3-4aa6-ab85-c4d514de3760 could not be found. Aug 05 20:12:08.986488 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'id': 'a9a46a51-71f3-4aa6-ab85-c4d514de3760'} Aug 05 20:12:08.987300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:12:08.987300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:08.987300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:12:08.987300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:12:08.987300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:12:08.987300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:12:08.987300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:12:08.987300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:12:08.987300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:12:08.987300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:12:08.987300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9a46a51-71f3-4aa6-ab85-c4d514de3760 could not be found. Aug 05 20:12:08.987300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:12:08.987300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:08.987300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:12:08.987300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:08.987300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:08.987300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:08.987300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:12:08.987300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:12:08.987300 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:12:08.989294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:12:08.989294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:12:08.989294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:12:08.989294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:12:08.989294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:12:08.989294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:12:08.989294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:12:08.989294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9a46a51-71f3-4aa6-ab85-c4d514de3760 could not be found. Aug 05 20:12:08.989294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:12:08.989294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:08.989294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:12:08.989294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:08.989294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:08.989294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:08.989294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:12:08.989294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:12:08.989294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9a46a51-71f3-4aa6-ab85-c4d514de3760 could not be found. Aug 05 20:12:08.989294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:12:08.990909 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-fa6fb4b9-ad85-4a92-a300-d4b243254398 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Returning 404 to user: Instance a9a46a51-71f3-4aa6-ab85-c4d514de3760 could not be found. {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:12:08.990909 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-fa6fb4b9-ad85-4a92-a300-d4b243254398 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760" status: 404 len: 111 microversion: 2.1 time: 0.034793 Aug 05 20:12:08.990909 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 491/960] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:08 2022] GET /compute/v2.1/servers/a9a46a51-71f3-4aa6-ab85-c4d514de3760 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:12:08.995676 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-78758a80-d3ba-45b2-b25a-bd47b1ba6a19 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] Calling method '.version_select at 0x7fe3e45cfc10>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:09.017687 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-78758a80-d3ba-45b2-b25a-bd47b1ba6a19 tempest-TestMinimumBasicScenario-1680758824 tempest-TestMinimumBasicScenario-1680758824-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-205380879" status: 202 len: 0 microversion: 2.1 time: 0.026203 Aug 05 20:12:09.021471 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 470/961] 10.222.0.39 () {58 vars in 1269 bytes} [Fri Aug 5 20:12:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-205380879 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:12:09.374591 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-fc7492c4-57b0-4db7-ab79-b354909d012e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1805537117", "imageRef": "c148255e-9574-4d10-b9bb-13c9411eda77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f6011fa2-4a48-4874-a9b5-7ab01c637069"}], "security_groups": [{"name": "tempest-securitygroup--789402823"}], "key_name": "tempest-keypair-767842823", "user_data": "}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:12:09.505621 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.network.neutron [None req-fc7492c4-57b0-4db7-ab79-b354909d012e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] validate_networks() for [('f6011fa2-4a48-4874-a9b5-7ab01c637069', None, None, None, None, None)] {{(pid=118192) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:12:09.961293 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-fc7492c4-57b0-4db7-ab79-b354909d012e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Flavor limits 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:12:09.961914 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-fc7492c4-57b0-4db7-ab79-b354909d012e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Image limits 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:12:09.962912 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-fc7492c4-57b0-4db7-ab79-b354909d012e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Flavor pref 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:12:09.963559 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-fc7492c4-57b0-4db7-ab79-b354909d012e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Image pref 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:12:09.964151 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-fc7492c4-57b0-4db7-ab79-b354909d012e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:12:09.975269 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fc7492c4-57b0-4db7-ab79-b354909d012e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:09.975942 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fc7492c4-57b0-4db7-ab79-b354909d012e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:09.976547 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fc7492c4-57b0-4db7-ab79-b354909d012e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:09.977425 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fc7492c4-57b0-4db7-ab79-b354909d012e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:09.977823 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fc7492c4-57b0-4db7-ab79-b354909d012e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:09.978259 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fc7492c4-57b0-4db7-ab79-b354909d012e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:10.003314 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-fc7492c4-57b0-4db7-ab79-b354909d012e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Getting quotas for project 790b5019b9114120a51718d99317f7a1. Resources: {'cores', 'ram', 'instances'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:12:10.009553 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-fc7492c4-57b0-4db7-ab79-b354909d012e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Getting quotas for user 305d1ce79a4f43c8b98e0967dab43da1 and project 790b5019b9114120a51718d99317f7a1. Resources: {'cores', 'ram', 'instances'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:12:10.026601 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-fc7492c4-57b0-4db7-ab79-b354909d012e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Going to run 1 instances... {{(pid=118192) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:12:10.029580 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-fc7492c4-57b0-4db7-ab79-b354909d012e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c148255e-9574-4d10-b9bb-13c9411eda77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:12:10.081146 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-fc7492c4-57b0-4db7-ab79-b354909d012e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.711770 Aug 05 20:12:10.082114 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 492/962] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Aug 5 20:12:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:12:10.095526 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-5a291b06-0dbc-4335-bf0c-943f34464d83 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:10.096330 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-5a291b06-0dbc-4335-bf0c-943f34464d83 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:10.168882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-5a291b06-0dbc-4335-bf0c-943f34464d83 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:10.177074 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-5a291b06-0dbc-4335-bf0c-943f34464d83 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1237 microversion: 2.1 time: 0.088215 Aug 05 20:12:10.178391 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 471/963] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:10 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1237 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:11.199791 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-2811123d-c85b-4477-b131-4cf54ab23f6a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:11.200509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-2811123d-c85b-4477-b131-4cf54ab23f6a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:11.207765 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2811123d-c85b-4477-b131-4cf54ab23f6a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:11.208261 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2811123d-c85b-4477-b131-4cf54ab23f6a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:11.208717 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2811123d-c85b-4477-b131-4cf54ab23f6a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:11.209745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2811123d-c85b-4477-b131-4cf54ab23f6a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:11.210497 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2811123d-c85b-4477-b131-4cf54ab23f6a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:11.211127 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2811123d-c85b-4477-b131-4cf54ab23f6a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:11.298199 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-2811123d-c85b-4477-b131-4cf54ab23f6a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:11.306516 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-2811123d-c85b-4477-b131-4cf54ab23f6a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1289 microversion: 2.1 time: 0.111056 Aug 05 20:12:11.307403 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 493/964] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:11 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1289 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:12.329958 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e508166e-7dcc-4138-8d52-ddb8d906b1ef tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:12.330595 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e508166e-7dcc-4138-8d52-ddb8d906b1ef tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:12.336998 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:12.350242 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e508166e-7dcc-4138-8d52-ddb8d906b1ef tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:12.351064 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e508166e-7dcc-4138-8d52-ddb8d906b1ef tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:12.351710 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e508166e-7dcc-4138-8d52-ddb8d906b1ef tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:12.352951 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e508166e-7dcc-4138-8d52-ddb8d906b1ef tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:12.354145 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e508166e-7dcc-4138-8d52-ddb8d906b1ef tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:12.356391 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e508166e-7dcc-4138-8d52-ddb8d906b1ef tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:12.659441 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e508166e-7dcc-4138-8d52-ddb8d906b1ef tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:12.673511 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e508166e-7dcc-4138-8d52-ddb8d906b1ef tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1362 microversion: 2.1 time: 0.346444 Aug 05 20:12:12.674814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 472/965] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:12 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1362 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:13.402916 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-76969e8c-593a-41b8-8752-326c4e4178b9 req-c61bb4d7-a979-46bd-9c29-be96017d9b32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4512b727-5582-4e39-ba18-58b3c42b79f0", "tag": "9d910af6-21ba-4feb-b1a1-74ae74dc2d0e"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:12:13.414801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-76969e8c-593a-41b8-8752-326c4e4178b9 req-c61bb4d7-a979-46bd-9c29-be96017d9b32 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:13.415322 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-76969e8c-593a-41b8-8752-326c4e4178b9 req-c61bb4d7-a979-46bd-9c29-be96017d9b32 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:13.415763 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-76969e8c-593a-41b8-8752-326c4e4178b9 req-c61bb4d7-a979-46bd-9c29-be96017d9b32 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:13.427931 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-76969e8c-593a-41b8-8752-326c4e4178b9 req-c61bb4d7-a979-46bd-9c29-be96017d9b32 service nova] Creating event network-changed:9d910af6-21ba-4feb-b1a1-74ae74dc2d0e for instance 4512b727-5582-4e39-ba18-58b3c42b79f0 on hv-cinder-85221 Aug 05 20:12:13.432839 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-76969e8c-593a-41b8-8752-326c4e4178b9 req-c61bb4d7-a979-46bd-9c29-be96017d9b32 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033923 Aug 05 20:12:13.433430 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 494/966] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:12:13.698397 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f3014b3e-0cf8-4f52-b8b9-b97fbb9498ff tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:13.699749 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f3014b3e-0cf8-4f52-b8b9-b97fbb9498ff tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:13.706941 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f3014b3e-0cf8-4f52-b8b9-b97fbb9498ff tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:13.707442 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f3014b3e-0cf8-4f52-b8b9-b97fbb9498ff tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:13.707884 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f3014b3e-0cf8-4f52-b8b9-b97fbb9498ff tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:13.708624 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f3014b3e-0cf8-4f52-b8b9-b97fbb9498ff tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:13.709091 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f3014b3e-0cf8-4f52-b8b9-b97fbb9498ff tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:13.709518 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f3014b3e-0cf8-4f52-b8b9-b97fbb9498ff tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:14.031018 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f3014b3e-0cf8-4f52-b8b9-b97fbb9498ff tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:14.048983 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f3014b3e-0cf8-4f52-b8b9-b97fbb9498ff tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1362 microversion: 2.1 time: 0.355845 Aug 05 20:12:14.049392 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 473/967] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:13 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1362 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:15.070940 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-45b88918-8b79-46e2-85e5-f57525e51bce tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:15.071526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-45b88918-8b79-46e2-85e5-f57525e51bce tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:15.078490 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-45b88918-8b79-46e2-85e5-f57525e51bce tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:15.078984 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-45b88918-8b79-46e2-85e5-f57525e51bce tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:15.079422 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-45b88918-8b79-46e2-85e5-f57525e51bce tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:15.080244 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-45b88918-8b79-46e2-85e5-f57525e51bce tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:15.080744 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-45b88918-8b79-46e2-85e5-f57525e51bce tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:15.081186 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-45b88918-8b79-46e2-85e5-f57525e51bce tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:15.219956 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-45b88918-8b79-46e2-85e5-f57525e51bce tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:15.227464 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-45b88918-8b79-46e2-85e5-f57525e51bce tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1362 microversion: 2.1 time: 0.160829 Aug 05 20:12:15.228022 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 495/968] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:15 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:16.250300 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7085ef26-1562-4618-9d79-59fec06b41ba tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:16.250300 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-7085ef26-1562-4618-9d79-59fec06b41ba tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:16.256206 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7085ef26-1562-4618-9d79-59fec06b41ba tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:16.256742 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7085ef26-1562-4618-9d79-59fec06b41ba tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:16.257180 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7085ef26-1562-4618-9d79-59fec06b41ba tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:16.258071 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7085ef26-1562-4618-9d79-59fec06b41ba tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:16.258703 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7085ef26-1562-4618-9d79-59fec06b41ba tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:16.259136 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7085ef26-1562-4618-9d79-59fec06b41ba tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:16.436521 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-7085ef26-1562-4618-9d79-59fec06b41ba tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:16.449903 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-7085ef26-1562-4618-9d79-59fec06b41ba tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1362 microversion: 2.1 time: 0.205097 Aug 05 20:12:16.450489 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 474/969] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:16 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:17.472748 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a684209e-bd73-4ac9-b222-7cd1114aba73 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:17.473481 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a684209e-bd73-4ac9-b222-7cd1114aba73 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:17.481192 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a684209e-bd73-4ac9-b222-7cd1114aba73 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:17.481819 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a684209e-bd73-4ac9-b222-7cd1114aba73 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:17.482337 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a684209e-bd73-4ac9-b222-7cd1114aba73 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:17.483260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a684209e-bd73-4ac9-b222-7cd1114aba73 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:17.483713 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a684209e-bd73-4ac9-b222-7cd1114aba73 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:17.484136 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a684209e-bd73-4ac9-b222-7cd1114aba73 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:17.633431 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a684209e-bd73-4ac9-b222-7cd1114aba73 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:17.642640 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a684209e-bd73-4ac9-b222-7cd1114aba73 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1362 microversion: 2.1 time: 0.174399 Aug 05 20:12:17.643291 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 496/970] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:17 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:18.663829 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-1c7e81b8-c86b-41ba-8106-3cbbb4326af0 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:18.664444 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-1c7e81b8-c86b-41ba-8106-3cbbb4326af0 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:18.671163 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1c7e81b8-c86b-41ba-8106-3cbbb4326af0 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:18.671646 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1c7e81b8-c86b-41ba-8106-3cbbb4326af0 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:18.672081 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1c7e81b8-c86b-41ba-8106-3cbbb4326af0 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:18.672810 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1c7e81b8-c86b-41ba-8106-3cbbb4326af0 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:18.673271 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1c7e81b8-c86b-41ba-8106-3cbbb4326af0 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:18.673700 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1c7e81b8-c86b-41ba-8106-3cbbb4326af0 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:18.808937 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-1c7e81b8-c86b-41ba-8106-3cbbb4326af0 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:18.817066 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-1c7e81b8-c86b-41ba-8106-3cbbb4326af0 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1362 microversion: 2.1 time: 0.157612 Aug 05 20:12:18.817647 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 475/971] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:18 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:19.170414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-050c4274-7acb-4da8-b708-8cc42b12c9e7 req-62acc73c-ccda-42f3-8046-c44a22a2e594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4512b727-5582-4e39-ba18-58b3c42b79f0", "name": "network-vif-plugged", "status": "completed", "tag": "9d910af6-21ba-4feb-b1a1-74ae74dc2d0e"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:12:19.182285 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-050c4274-7acb-4da8-b708-8cc42b12c9e7 req-62acc73c-ccda-42f3-8046-c44a22a2e594 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:19.184279 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-050c4274-7acb-4da8-b708-8cc42b12c9e7 req-62acc73c-ccda-42f3-8046-c44a22a2e594 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:19.184279 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-050c4274-7acb-4da8-b708-8cc42b12c9e7 req-62acc73c-ccda-42f3-8046-c44a22a2e594 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:19.195086 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-050c4274-7acb-4da8-b708-8cc42b12c9e7 req-62acc73c-ccda-42f3-8046-c44a22a2e594 service nova] Creating event network-vif-plugged:9d910af6-21ba-4feb-b1a1-74ae74dc2d0e for instance 4512b727-5582-4e39-ba18-58b3c42b79f0 on hv-cinder-85221 Aug 05 20:12:19.200403 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-050c4274-7acb-4da8-b708-8cc42b12c9e7 req-62acc73c-ccda-42f3-8046-c44a22a2e594 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033300 Aug 05 20:12:19.200960 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 497/972] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:12:19.838027 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7fbbeef9-b2b5-4cab-9bf1-08f5482ded02 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:19.838644 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-7fbbeef9-b2b5-4cab-9bf1-08f5482ded02 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:19.845927 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7fbbeef9-b2b5-4cab-9bf1-08f5482ded02 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:19.846416 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7fbbeef9-b2b5-4cab-9bf1-08f5482ded02 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:19.846885 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7fbbeef9-b2b5-4cab-9bf1-08f5482ded02 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:19.847578 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7fbbeef9-b2b5-4cab-9bf1-08f5482ded02 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:19.848034 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7fbbeef9-b2b5-4cab-9bf1-08f5482ded02 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:19.848463 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7fbbeef9-b2b5-4cab-9bf1-08f5482ded02 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:19.976531 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-7fbbeef9-b2b5-4cab-9bf1-08f5482ded02 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:19.984446 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-7fbbeef9-b2b5-4cab-9bf1-08f5482ded02 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1362 microversion: 2.1 time: 0.150216 Aug 05 20:12:19.985050 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 476/973] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:19 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:21.007752 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-12efb70e-9c92-436c-af32-ba6d62956b3c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:21.009027 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-12efb70e-9c92-436c-af32-ba6d62956b3c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:21.011451 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell0:SELECT=2 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:21.012377 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell0:SELECT=6 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:21.019623 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-12efb70e-9c92-436c-af32-ba6d62956b3c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:21.020113 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-12efb70e-9c92-436c-af32-ba6d62956b3c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:21.021999 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-12efb70e-9c92-436c-af32-ba6d62956b3c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:21.021999 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-12efb70e-9c92-436c-af32-ba6d62956b3c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:21.021999 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-12efb70e-9c92-436c-af32-ba6d62956b3c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:21.022297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-12efb70e-9c92-436c-af32-ba6d62956b3c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:21.039980 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:21.173780 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-12efb70e-9c92-436c-af32-ba6d62956b3c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:21.182063 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-12efb70e-9c92-436c-af32-ba6d62956b3c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1362 microversion: 2.1 time: 0.178981 Aug 05 20:12:21.182673 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 498/974] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:21 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:22.203575 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-b9e1a54f-507a-4253-9860-efbf780a2e7e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:22.204184 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-b9e1a54f-507a-4253-9860-efbf780a2e7e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:22.206085 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=6 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:22.211807 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b9e1a54f-507a-4253-9860-efbf780a2e7e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:22.212297 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b9e1a54f-507a-4253-9860-efbf780a2e7e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:22.212765 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b9e1a54f-507a-4253-9860-efbf780a2e7e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:22.213458 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b9e1a54f-507a-4253-9860-efbf780a2e7e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:22.213911 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b9e1a54f-507a-4253-9860-efbf780a2e7e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:22.214338 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b9e1a54f-507a-4253-9860-efbf780a2e7e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:22.348694 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-b9e1a54f-507a-4253-9860-efbf780a2e7e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:22.356138 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-b9e1a54f-507a-4253-9860-efbf780a2e7e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1549 microversion: 2.1 time: 0.157376 Aug 05 20:12:22.356730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 477/975] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:22 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:12:22.376132 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-8c8c7146-42b1-4be8-93ca-6651b4d6d985 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:22.376665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-8c8c7146-42b1-4be8-93ca-6651b4d6d985 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:22.383032 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8c8c7146-42b1-4be8-93ca-6651b4d6d985 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:22.383510 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8c8c7146-42b1-4be8-93ca-6651b4d6d985 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:22.383942 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8c8c7146-42b1-4be8-93ca-6651b4d6d985 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:22.384651 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8c8c7146-42b1-4be8-93ca-6651b4d6d985 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:22.385107 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8c8c7146-42b1-4be8-93ca-6651b4d6d985 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:22.385528 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8c8c7146-42b1-4be8-93ca-6651b4d6d985 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:22.465782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-8c8c7146-42b1-4be8-93ca-6651b4d6d985 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093468 Aug 05 20:12:22.466361 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 499/976] 10.222.0.39 () {58 vars in 1275 bytes} [Fri Aug 5 20:12:22 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:12:23.659348 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-ddcb04ac-e19a-4ef0-a3ad-e4570a2873b2 req-28b6aded-5248-48bb-a5b4-79e3c54da905 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4512b727-5582-4e39-ba18-58b3c42b79f0", "tag": "9d910af6-21ba-4feb-b1a1-74ae74dc2d0e"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:12:23.668980 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-ddcb04ac-e19a-4ef0-a3ad-e4570a2873b2 req-28b6aded-5248-48bb-a5b4-79e3c54da905 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:23.669567 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-ddcb04ac-e19a-4ef0-a3ad-e4570a2873b2 req-28b6aded-5248-48bb-a5b4-79e3c54da905 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:23.670068 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-ddcb04ac-e19a-4ef0-a3ad-e4570a2873b2 req-28b6aded-5248-48bb-a5b4-79e3c54da905 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:23.682208 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-ddcb04ac-e19a-4ef0-a3ad-e4570a2873b2 req-28b6aded-5248-48bb-a5b4-79e3c54da905 service nova] Creating event network-changed:9d910af6-21ba-4feb-b1a1-74ae74dc2d0e for instance 4512b727-5582-4e39-ba18-58b3c42b79f0 on hv-cinder-85221 Aug 05 20:12:23.687978 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-ddcb04ac-e19a-4ef0-a3ad-e4570a2873b2 req-28b6aded-5248-48bb-a5b4-79e3c54da905 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032341 Aug 05 20:12:23.688817 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 478/977] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:12:46.820716 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:46.821466 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=7 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:46.825295 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4e2094ff-aa59-466b-b9db-0eb8ba1c3d0e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:46.825785 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-4e2094ff-aa59-466b-b9db-0eb8ba1c3d0e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:46.832644 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4e2094ff-aa59-466b-b9db-0eb8ba1c3d0e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:46.833127 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4e2094ff-aa59-466b-b9db-0eb8ba1c3d0e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:46.833562 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4e2094ff-aa59-466b-b9db-0eb8ba1c3d0e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:46.834251 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4e2094ff-aa59-466b-b9db-0eb8ba1c3d0e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:46.834703 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4e2094ff-aa59-466b-b9db-0eb8ba1c3d0e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:46.835125 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4e2094ff-aa59-466b-b9db-0eb8ba1c3d0e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:46.858517 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-4e2094ff-aa59-466b-b9db-0eb8ba1c3d0e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb/ips" status: 200 len: 151 microversion: 2.1 time: 0.039368 Aug 05 20:12:46.859068 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 500/978] 10.222.0.39 () {58 vars in 1248 bytes} [Fri Aug 5 20:12:46 2022] GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:12:49.254190 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=13 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:49.254931 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=75 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:49.516197 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-debe84de-3b01-41e1-b1cc-eac1d1bdd7fb tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26d7d2ce-f1ca-4ab1-b9f7-56480678e804"}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:12:49.518936 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-debe84de-3b01-41e1-b1cc-eac1d1bdd7fb tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:49.525119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-debe84de-3b01-41e1-b1cc-eac1d1bdd7fb tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:49.525605 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-debe84de-3b01-41e1-b1cc-eac1d1bdd7fb tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:49.526038 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-debe84de-3b01-41e1-b1cc-eac1d1bdd7fb tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:49.526731 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-debe84de-3b01-41e1-b1cc-eac1d1bdd7fb tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:49.527186 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-debe84de-3b01-41e1-b1cc-eac1d1bdd7fb tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:49.527610 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-debe84de-3b01-41e1-b1cc-eac1d1bdd7fb tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:49.944195 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-debe84de-3b01-41e1-b1cc-eac1d1bdd7fb tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "POST /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.695737 Aug 05 20:12:49.944856 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 479/979] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Aug 5 20:12:49 2022] POST /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb/os-volume_attachments => generated 194 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:12:57.483077 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-704ee01d-a5a6-4978-8dd8-7de72b20289b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26d7d2ce-f1ca-4ab1-b9f7-56480678e804"}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:12:57.485939 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-704ee01d-a5a6-4978-8dd8-7de72b20289b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:57.487947 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=2 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:57.488661 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=4 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:12:57.494873 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-704ee01d-a5a6-4978-8dd8-7de72b20289b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:57.495371 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-704ee01d-a5a6-4978-8dd8-7de72b20289b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:57.495816 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-704ee01d-a5a6-4978-8dd8-7de72b20289b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:57.496530 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-704ee01d-a5a6-4978-8dd8-7de72b20289b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:57.497015 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-704ee01d-a5a6-4978-8dd8-7de72b20289b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:57.497449 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-704ee01d-a5a6-4978-8dd8-7de72b20289b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:57.629796 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-704ee01d-a5a6-4978-8dd8-7de72b20289b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] HTTP exception thrown: Invalid volume: volume 26d7d2ce-f1ca-4ab1-b9f7-56480678e804 is already attached to instances: f4539af4-0b20-4505-801a-6adb0b19cddb Aug 05 20:12:57.631525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-704ee01d-a5a6-4978-8dd8-7de72b20289b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Request method failure captured: Aug 05 20:12:57.631525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: POST /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb/os-volume_attachments HTTP/1.1 Aug 05 20:12:57.631525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:12:57.631525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:12:57.631525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:12:57.631525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 74 Aug 05 20:12:57.631525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:12:57.631525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:12:57.631525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:12:57.631525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:12:57.631525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XdntYBLdlzvV7cyFg7UZC73a9OJV17dQagpc389c8g9F6eau2Yker8zNfrWRXvHE1X0s0ayqdbHqjuJX7Cxd2dg4OAmYf40eOt9KRb9kWilSf-b7MsgEH66CO1Uwzjbe3hC1fmQKpJ9W4mMdw5ek_dNUUbduEc7m-XkxS7A18A4T74 Aug 05 20:12:57.631525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:12:57.631525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:12:57.631525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:12:57.631525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:12:57.631525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:12:57.631525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:12:57.631525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:12:57.631525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:12:57.631525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:12:57.631525 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:12:57.633290 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5b265913f9bd46b9b36c18d567d0cf66", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:12:57.633290 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:12:57.633290 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:12:57.633290 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:12:57.633290 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:12:57.633290 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:12:57.633290 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:12:57.633290 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: 1afe13c8fbb1468b8ef3d0d0c671208d Aug 05 20:12:57.633290 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:12:57.633290 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Aug 05 20:12:57.633290 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {"volumeAttachment": {"volumeId": "26d7d2ce-f1ca-4ab1-b9f7-56480678e804"}} Aug 05 20:12:57.633290 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: > Aug 05 20:12:57.634305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Invalid volume: volume 26d7d2ce-f1ca-4ab1-b9f7-56480678e804 is already attached to instances: f4539af4-0b20-4505-801a-6adb0b19cddb Aug 05 20:12:57.634305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'server_id': 'f4539af4-0b20-4505-801a-6adb0b19cddb', 'body': {'volumeAttachment': {'volumeId': '26d7d2ce-f1ca-4ab1-b9f7-56480678e804'}}} Aug 05 20:12:57.634305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:12:57.634305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:57.634305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 20:12:57.634305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 20:12:57.634305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 20:12:57.634305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 20:12:57.634305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 05 20:12:57.634305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 05 20:12:57.634305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 05 20:12:57.634305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 05 20:12:57.634305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 05 20:12:57.634305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 05 20:12:57.634305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 26d7d2ce-f1ca-4ab1-b9f7-56480678e804 is already attached to instances: f4539af4-0b20-4505-801a-6adb0b19cddb Aug 05 20:12:57.634305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:12:57.634305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:57.634305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:12:57.634305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:57.635817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:57.635817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:57.635817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:12:57.635817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:12:57.635817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:12:57.635817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:12:57.635817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:12:57.635817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:12:57.635817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:12:57.635817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:12:57.635817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:12:57.635817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:12:57.635817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 05 20:12:57.635817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 05 20:12:57.635817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 26d7d2ce-f1ca-4ab1-b9f7-56480678e804 is already attached to instances: f4539af4-0b20-4505-801a-6adb0b19cddb Aug 05 20:12:57.635817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:12:57.635817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:12:57.635817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:12:57.635817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:12:57.635817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:12:57.637869 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:12:57.637869 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:12:57.637869 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:12:57.637869 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 26d7d2ce-f1ca-4ab1-b9f7-56480678e804 is already attached to instances: f4539af4-0b20-4505-801a-6adb0b19cddb Aug 05 20:12:57.637869 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:12:57.637869 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-704ee01d-a5a6-4978-8dd8-7de72b20289b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Returning 400 to user: Invalid volume: volume 26d7d2ce-f1ca-4ab1-b9f7-56480678e804 is already attached to instances: f4539af4-0b20-4505-801a-6adb0b19cddb {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:12:57.637869 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-704ee01d-a5a6-4978-8dd8-7de72b20289b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "POST /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.154193 Aug 05 20:12:57.637869 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 501/980] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Aug 5 20:12:57 2022] POST /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb/os-volume_attachments => generated 174 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 20:12:57.701922 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-650ec456-155f-444a-8c71-4019392fc6c8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:57.702494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-650ec456-155f-444a-8c71-4019392fc6c8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:57.708935 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-650ec456-155f-444a-8c71-4019392fc6c8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:57.709421 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-650ec456-155f-444a-8c71-4019392fc6c8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:57.709846 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-650ec456-155f-444a-8c71-4019392fc6c8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:57.710540 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-650ec456-155f-444a-8c71-4019392fc6c8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:57.710985 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-650ec456-155f-444a-8c71-4019392fc6c8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:57.711422 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-650ec456-155f-444a-8c71-4019392fc6c8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:57.799384 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.objects.instance [None req-650ec456-155f-444a-8c71-4019392fc6c8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lazy-loading 'services' on Instance uuid f4539af4-0b20-4505-801a-6adb0b19cddb {{(pid=118191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:12:57.879796 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-650ec456-155f-444a-8c71-4019392fc6c8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb/os-volume_attachments/26d7d2ce-f1ca-4ab1-b9f7-56480678e804" status: 202 len: 0 microversion: 2.1 time: 0.182573 Aug 05 20:12:57.880386 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 480/981] 10.222.0.39 () {58 vars in 1416 bytes} [Fri Aug 5 20:12:57 2022] DELETE /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb/os-volume_attachments/26d7d2ce-f1ca-4ab1-b9f7-56480678e804 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:12:57.889732 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a13d60f4-a61f-441a-b0fb-e35208834b1b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:57.892479 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a13d60f4-a61f-441a-b0fb-e35208834b1b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:57.899917 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a13d60f4-a61f-441a-b0fb-e35208834b1b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:57.900419 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a13d60f4-a61f-441a-b0fb-e35208834b1b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:57.900889 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a13d60f4-a61f-441a-b0fb-e35208834b1b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:57.901644 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a13d60f4-a61f-441a-b0fb-e35208834b1b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:57.902104 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a13d60f4-a61f-441a-b0fb-e35208834b1b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:57.902584 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a13d60f4-a61f-441a-b0fb-e35208834b1b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:57.934782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a13d60f4-a61f-441a-b0fb-e35208834b1b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049270 Aug 05 20:12:57.935805 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 502/982] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Aug 5 20:12:57 2022] GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:12:58.948908 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f25b74e2-25d9-4c7b-ac46-cf277f8907f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:58.951344 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f25b74e2-25d9-4c7b-ac46-cf277f8907f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:58.957855 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f25b74e2-25d9-4c7b-ac46-cf277f8907f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:58.958347 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f25b74e2-25d9-4c7b-ac46-cf277f8907f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:58.958780 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f25b74e2-25d9-4c7b-ac46-cf277f8907f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:58.959471 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f25b74e2-25d9-4c7b-ac46-cf277f8907f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:58.959922 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f25b74e2-25d9-4c7b-ac46-cf277f8907f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:58.960342 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f25b74e2-25d9-4c7b-ac46-cf277f8907f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:58.991144 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f25b74e2-25d9-4c7b-ac46-cf277f8907f5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047064 Aug 05 20:12:58.991849 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 481/983] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Aug 5 20:12:58 2022] GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:12:59.055791 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-76cce512-3028-4f2b-ac60-69ff8bf8fc7d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:59.056339 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-76cce512-3028-4f2b-ac60-69ff8bf8fc7d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:59.063296 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-76cce512-3028-4f2b-ac60-69ff8bf8fc7d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:59.063844 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-76cce512-3028-4f2b-ac60-69ff8bf8fc7d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:59.064273 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-76cce512-3028-4f2b-ac60-69ff8bf8fc7d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:59.064990 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-76cce512-3028-4f2b-ac60-69ff8bf8fc7d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:59.065450 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-76cce512-3028-4f2b-ac60-69ff8bf8fc7d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:59.065874 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-76cce512-3028-4f2b-ac60-69ff8bf8fc7d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:59.089768 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-76cce512-3028-4f2b-ac60-69ff8bf8fc7d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Going to try to terminate instance {{(pid=118192) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:12:59.170738 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-76cce512-3028-4f2b-ac60-69ff8bf8fc7d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb" status: 204 len: 0 microversion: 2.1 time: 0.118549 Aug 05 20:12:59.171239 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 503/984] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:12:59 2022] DELETE /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:12:59.180854 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-673f6965-1b55-4c81-af34-dd4a655c7b3a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:12:59.181584 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-673f6965-1b55-4c81-af34-dd4a655c7b3a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:12:59.188456 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-673f6965-1b55-4c81-af34-dd4a655c7b3a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:59.189195 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-673f6965-1b55-4c81-af34-dd4a655c7b3a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:59.189689 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-673f6965-1b55-4c81-af34-dd4a655c7b3a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:59.190401 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-673f6965-1b55-4c81-af34-dd4a655c7b3a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:12:59.190858 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-673f6965-1b55-4c81-af34-dd4a655c7b3a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:12:59.191286 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-673f6965-1b55-4c81-af34-dd4a655c7b3a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:12:59.322868 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-673f6965-1b55-4c81-af34-dd4a655c7b3a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:12:59.330710 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-673f6965-1b55-4c81-af34-dd4a655c7b3a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb" status: 200 len: 1681 microversion: 2.1 time: 0.153807 Aug 05 20:12:59.331295 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 482/985] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:12:59 2022] GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:00.353466 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-8aff832f-bcff-4d86-b998-f5e9fe056296 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:00.354157 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-8aff832f-bcff-4d86-b998-f5e9fe056296 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:00.361368 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8aff832f-bcff-4d86-b998-f5e9fe056296 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:00.361852 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8aff832f-bcff-4d86-b998-f5e9fe056296 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:00.362284 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8aff832f-bcff-4d86-b998-f5e9fe056296 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:00.362965 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8aff832f-bcff-4d86-b998-f5e9fe056296 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:00.363418 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8aff832f-bcff-4d86-b998-f5e9fe056296 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:00.363839 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8aff832f-bcff-4d86-b998-f5e9fe056296 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:00.499207 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-8aff832f-bcff-4d86-b998-f5e9fe056296 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:00.506941 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-8aff832f-bcff-4d86-b998-f5e9fe056296 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb" status: 200 len: 1681 microversion: 2.1 time: 0.157699 Aug 05 20:13:00.507503 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 504/986] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:00 2022] GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:01.529526 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f8ac3339-4827-44b6-8868-cfe107363574 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:01.530283 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f8ac3339-4827-44b6-8868-cfe107363574 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:01.537616 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f8ac3339-4827-44b6-8868-cfe107363574 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:01.538110 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f8ac3339-4827-44b6-8868-cfe107363574 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:01.538550 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f8ac3339-4827-44b6-8868-cfe107363574 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:01.539320 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f8ac3339-4827-44b6-8868-cfe107363574 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:01.539778 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f8ac3339-4827-44b6-8868-cfe107363574 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:01.540235 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f8ac3339-4827-44b6-8868-cfe107363574 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:01.771014 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f8ac3339-4827-44b6-8868-cfe107363574 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:01.778923 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f8ac3339-4827-44b6-8868-cfe107363574 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb" status: 200 len: 1681 microversion: 2.1 time: 0.253383 Aug 05 20:13:01.779714 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 483/987] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:01 2022] GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb => generated 1681 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:02.438948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-a314bed1-20ae-43fc-a403-107beab96230 req-ecbf2e60-cebf-4e4b-a167-e98c5c1340ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4539af4-0b20-4505-801a-6adb0b19cddb", "name": "network-vif-deleted", "tag": "d953e10e-e397-4f7c-b322-32c965ba3c7a"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:02.451028 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-a314bed1-20ae-43fc-a403-107beab96230 req-ecbf2e60-cebf-4e4b-a167-e98c5c1340ec service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:02.452040 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-a314bed1-20ae-43fc-a403-107beab96230 req-ecbf2e60-cebf-4e4b-a167-e98c5c1340ec service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:02.452950 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-a314bed1-20ae-43fc-a403-107beab96230 req-ecbf2e60-cebf-4e4b-a167-e98c5c1340ec service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:02.465534 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-a314bed1-20ae-43fc-a403-107beab96230 req-ecbf2e60-cebf-4e4b-a167-e98c5c1340ec service nova] Creating event network-vif-deleted:d953e10e-e397-4f7c-b322-32c965ba3c7a for instance f4539af4-0b20-4505-801a-6adb0b19cddb on hv-cinder-85221 Aug 05 20:13:02.471749 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-a314bed1-20ae-43fc-a403-107beab96230 req-ecbf2e60-cebf-4e4b-a167-e98c5c1340ec service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037693 Aug 05 20:13:02.473151 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 505/988] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:13:02.802338 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-82e80c64-03db-454c-9ea6-c42637578934 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:02.803035 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-82e80c64-03db-454c-9ea6-c42637578934 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:02.809592 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-82e80c64-03db-454c-9ea6-c42637578934 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:02.810072 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-82e80c64-03db-454c-9ea6-c42637578934 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:02.810505 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-82e80c64-03db-454c-9ea6-c42637578934 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:02.811190 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-82e80c64-03db-454c-9ea6-c42637578934 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:02.811637 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-82e80c64-03db-454c-9ea6-c42637578934 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:02.812056 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-82e80c64-03db-454c-9ea6-c42637578934 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:02.845843 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-82e80c64-03db-454c-9ea6-c42637578934 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:02.846333 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-82e80c64-03db-454c-9ea6-c42637578934 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:02.846767 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-82e80c64-03db-454c-9ea6-c42637578934 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:02.847216 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.objects.instance [None req-82e80c64-03db-454c-9ea6-c42637578934 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lazy-loading 'fault' on Instance uuid f4539af4-0b20-4505-801a-6adb0b19cddb {{(pid=118191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:13:02.889666 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-82e80c64-03db-454c-9ea6-c42637578934 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:02.897712 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-82e80c64-03db-454c-9ea6-c42637578934 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb" status: 200 len: 1330 microversion: 2.1 time: 0.099907 Aug 05 20:13:02.898286 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 484/989] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:02 2022] GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb => generated 1330 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:13:03.483758 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-8abafbe5-7853-4687-9db3-3dccc181fc65 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:03.484398 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-8abafbe5-7853-4687-9db3-3dccc181fc65 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:03.491170 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8abafbe5-7853-4687-9db3-3dccc181fc65 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:03.491662 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8abafbe5-7853-4687-9db3-3dccc181fc65 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:03.492109 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8abafbe5-7853-4687-9db3-3dccc181fc65 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:03.492907 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8abafbe5-7853-4687-9db3-3dccc181fc65 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:03.493373 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8abafbe5-7853-4687-9db3-3dccc181fc65 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:03.493807 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8abafbe5-7853-4687-9db3-3dccc181fc65 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:03.520224 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-8abafbe5-7853-4687-9db3-3dccc181fc65 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Going to try to terminate instance {{(pid=118192) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:13:03.592131 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-8abafbe5-7853-4687-9db3-3dccc181fc65 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "DELETE /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 204 len: 0 microversion: 2.1 time: 0.112755 Aug 05 20:13:03.592735 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 506/990] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:13:03 2022] DELETE /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:13:03.601107 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3c95b5ac-0108-44b9-b692-0f67ac03c8fb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:03.601719 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-3c95b5ac-0108-44b9-b692-0f67ac03c8fb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:03.609705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3c95b5ac-0108-44b9-b692-0f67ac03c8fb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:03.610182 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3c95b5ac-0108-44b9-b692-0f67ac03c8fb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:03.611208 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3c95b5ac-0108-44b9-b692-0f67ac03c8fb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:03.611896 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3c95b5ac-0108-44b9-b692-0f67ac03c8fb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:03.612347 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3c95b5ac-0108-44b9-b692-0f67ac03c8fb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:03.612810 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3c95b5ac-0108-44b9-b692-0f67ac03c8fb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:03.744201 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3c95b5ac-0108-44b9-b692-0f67ac03c8fb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:03.753164 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3c95b5ac-0108-44b9-b692-0f67ac03c8fb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1577 microversion: 2.1 time: 0.155926 Aug 05 20:13:03.753744 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 485/991] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:03 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:03.919280 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-50006bc8-7b95-492f-b28b-2e28f051625c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:03.919992 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-50006bc8-7b95-492f-b28b-2e28f051625c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:03.926421 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-50006bc8-7b95-492f-b28b-2e28f051625c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:03.926904 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-50006bc8-7b95-492f-b28b-2e28f051625c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:03.927339 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-50006bc8-7b95-492f-b28b-2e28f051625c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:03.928022 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-50006bc8-7b95-492f-b28b-2e28f051625c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:03.928474 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-50006bc8-7b95-492f-b28b-2e28f051625c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:03.928919 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-50006bc8-7b95-492f-b28b-2e28f051625c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:03.942492 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-50006bc8-7b95-492f-b28b-2e28f051625c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] HTTP exception thrown: Instance f4539af4-0b20-4505-801a-6adb0b19cddb could not be found. Aug 05 20:13:03.944058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-50006bc8-7b95-492f-b28b-2e28f051625c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Request method failure captured: Aug 05 20:13:03.944058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb HTTP/1.1 Aug 05 20:13:03.944058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:13:03.944058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:13:03.944058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:13:03.944058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 0 Aug 05 20:13:03.944058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:13:03.944058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:13:03.944058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:13:03.944058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:13:03.944058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XdntYBLdlzvV7cyFg7UZC73a9OJV17dQagpc389c8g9F6eau2Yker8zNfrWRXvHE1X0s0ayqdbHqjuJX7Cxd2dg4OAmYf40eOt9KRb9kWilSf-b7MsgEH66CO1Uwzjbe3hC1fmQKpJ9W4mMdw5ek_dNUUbduEc7m-XkxS7A18A4T74 Aug 05 20:13:03.944058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:13:03.944058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:13:03.944058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:13:03.944058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:13:03.944058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:13:03.944058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:13:03.944058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:13:03.944058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:13:03.944058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:13:03.944058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:13:03.945781 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5b265913f9bd46b9b36c18d567d0cf66", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:13:03.945781 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:13:03.945781 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:13:03.945781 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:13:03.945781 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:13:03.945781 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:13:03.945781 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:13:03.945781 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: 1afe13c8fbb1468b8ef3d0d0c671208d Aug 05 20:13:03.945781 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:13:03.945781 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: > Aug 05 20:13:03.945781 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Instance f4539af4-0b20-4505-801a-6adb0b19cddb could not be found. Aug 05 20:13:03.945781 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'id': 'f4539af4-0b20-4505-801a-6adb0b19cddb'} Aug 05 20:13:03.946752 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:13:03.946752 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:13:03.946752 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:13:03.946752 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:13:03.946752 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:13:03.946752 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:13:03.946752 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:13:03.946752 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:13:03.946752 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:13:03.946752 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:13:03.946752 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4539af4-0b20-4505-801a-6adb0b19cddb could not be found. Aug 05 20:13:03.946752 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:13:03.946752 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:13:03.946752 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:13:03.946752 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:13:03.946752 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:13:03.946752 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:13:03.946752 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:13:03.946752 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:13:03.946752 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:13:03.948319 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:13:03.948319 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:13:03.948319 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:13:03.948319 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:13:03.948319 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:13:03.948319 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:13:03.948319 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:13:03.948319 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4539af4-0b20-4505-801a-6adb0b19cddb could not be found. Aug 05 20:13:03.948319 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:13:03.948319 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:13:03.948319 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:13:03.948319 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:13:03.948319 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:13:03.948319 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:13:03.948319 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:13:03.948319 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:13:03.948319 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4539af4-0b20-4505-801a-6adb0b19cddb could not be found. Aug 05 20:13:03.948319 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:13:03.949766 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-50006bc8-7b95-492f-b28b-2e28f051625c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Returning 404 to user: Instance f4539af4-0b20-4505-801a-6adb0b19cddb could not be found. {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:13:03.949766 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-50006bc8-7b95-492f-b28b-2e28f051625c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb" status: 404 len: 111 microversion: 2.1 time: 0.030435 Aug 05 20:13:03.949766 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 507/992] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:03 2022] GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:13:03.954756 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a4cf9951-3b1c-47bc-9002-ae1c18b5853a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '.version_select at 0x7fe3e45cfca0>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:03.972874 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-a4cf9951-3b1c-47bc-9002-ae1c18b5853a tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-841158896" status: 202 len: 0 microversion: 2.1 time: 0.022454 Aug 05 20:13:03.973427 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 486/993] 10.222.0.39 () {58 vars in 1218 bytes} [Fri Aug 5 20:13:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-841158896 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:13:04.592404 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-1c311b76-c647-4bce-a0f0-36b923a49205 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Action: 'create', calling method: .version_select at 0x7fe3e4508a60>, body: {"keypair": {"name": "tempest-keypair-55715630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZM9Dtz5sZJA/eZyzxqNVDAnh7oRZjWI3OUQOGqdYQ3l4a0ki1rvmGK17wvXhnynY61JXTlCnFSaX+0RCgSD4uCb4LtFrhVFUKW8plgTp5teFQs4HwJuBnTAsRINHV6kA=="}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:04.608921 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-1c311b76-c647-4bce-a0f0-36b923a49205 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Getting quotas for project 5b265913f9bd46b9b36c18d567d0cf66. Resources: {'key_pairs'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:13:04.612854 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-1c311b76-c647-4bce-a0f0-36b923a49205 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Getting quotas for user 1afe13c8fbb1468b8ef3d0d0c671208d and project 5b265913f9bd46b9b36c18d567d0cf66. Resources: {'key_pairs'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:13:04.634723 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-1c311b76-c647-4bce-a0f0-36b923a49205 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.046214 Aug 05 20:13:04.635301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 508/994] 10.222.0.39 () {60 vars in 1159 bytes} [Fri Aug 5 20:13:04 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:13:04.774986 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3819d7a0-5f96-41c7-a48f-2c7e6e31f158 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:04.775605 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-3819d7a0-5f96-41c7-a48f-2c7e6e31f158 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:04.793870 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3819d7a0-5f96-41c7-a48f-2c7e6e31f158 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:04.794408 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3819d7a0-5f96-41c7-a48f-2c7e6e31f158 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:04.794846 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3819d7a0-5f96-41c7-a48f-2c7e6e31f158 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:04.795556 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3819d7a0-5f96-41c7-a48f-2c7e6e31f158 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:04.796011 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3819d7a0-5f96-41c7-a48f-2c7e6e31f158 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:04.796430 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3819d7a0-5f96-41c7-a48f-2c7e6e31f158 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:04.937572 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3819d7a0-5f96-41c7-a48f-2c7e6e31f158 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:04.958925 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3819d7a0-5f96-41c7-a48f-2c7e6e31f158 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1577 microversion: 2.1 time: 0.188180 Aug 05 20:13:04.959608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 487/995] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:04 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1577 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:05.896859 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b77bde6e-3c8b-4e7c-8457-54e4af6f6de8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2099153097", "imageRef": "c148255e-9574-4d10-b9bb-13c9411eda77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d7536c13-8fba-4a9d-87ec-6a7bf401477c"}], "security_groups": [{"name": "tempest-securitygroup--1422789098"}], "key_name": "tempest-keypair-55715630", "user_data": "}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:05.981101 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-48fedd1b-e7af-4cff-9f1e-9eb32a470f25 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:05.981737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-48fedd1b-e7af-4cff-9f1e-9eb32a470f25 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:05.989435 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-48fedd1b-e7af-4cff-9f1e-9eb32a470f25 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:05.989946 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-48fedd1b-e7af-4cff-9f1e-9eb32a470f25 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:05.990393 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-48fedd1b-e7af-4cff-9f1e-9eb32a470f25 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:05.991123 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-48fedd1b-e7af-4cff-9f1e-9eb32a470f25 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:05.991586 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-48fedd1b-e7af-4cff-9f1e-9eb32a470f25 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:05.992015 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-48fedd1b-e7af-4cff-9f1e-9eb32a470f25 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:06.106696 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.network.neutron [None req-b77bde6e-3c8b-4e7c-8457-54e4af6f6de8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] validate_networks() for [('d7536c13-8fba-4a9d-87ec-6a7bf401477c', None, None, None, None, None)] {{(pid=118192) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:13:06.363508 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-48fedd1b-e7af-4cff-9f1e-9eb32a470f25 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:06.371430 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-48fedd1b-e7af-4cff-9f1e-9eb32a470f25 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1577 microversion: 2.1 time: 0.394164 Aug 05 20:13:06.372042 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 488/996] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:05 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1577 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:13:07.093293 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-b77bde6e-3c8b-4e7c-8457-54e4af6f6de8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Flavor limits 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:13:07.093940 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-b77bde6e-3c8b-4e7c-8457-54e4af6f6de8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Image limits 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:13:07.094653 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-b77bde6e-3c8b-4e7c-8457-54e4af6f6de8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Flavor pref 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:13:07.096350 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-b77bde6e-3c8b-4e7c-8457-54e4af6f6de8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Image pref 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:13:07.096350 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-b77bde6e-3c8b-4e7c-8457-54e4af6f6de8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:13:07.106964 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b77bde6e-3c8b-4e7c-8457-54e4af6f6de8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:07.107384 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b77bde6e-3c8b-4e7c-8457-54e4af6f6de8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:07.108008 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b77bde6e-3c8b-4e7c-8457-54e4af6f6de8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:07.108860 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b77bde6e-3c8b-4e7c-8457-54e4af6f6de8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:07.109328 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b77bde6e-3c8b-4e7c-8457-54e4af6f6de8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:07.109756 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b77bde6e-3c8b-4e7c-8457-54e4af6f6de8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:07.129945 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-b77bde6e-3c8b-4e7c-8457-54e4af6f6de8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Getting quotas for project 5b265913f9bd46b9b36c18d567d0cf66. Resources: {'cores', 'ram', 'instances'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:13:07.134021 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-b77bde6e-3c8b-4e7c-8457-54e4af6f6de8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Getting quotas for user 1afe13c8fbb1468b8ef3d0d0c671208d and project 5b265913f9bd46b9b36c18d567d0cf66. Resources: {'cores', 'ram', 'instances'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:13:07.145761 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-b77bde6e-3c8b-4e7c-8457-54e4af6f6de8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Going to run 1 instances... {{(pid=118192) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:13:07.148055 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-b77bde6e-3c8b-4e7c-8457-54e4af6f6de8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c148255e-9574-4d10-b9bb-13c9411eda77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:13:07.197283 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b77bde6e-3c8b-4e7c-8457-54e4af6f6de8 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.305944 Aug 05 20:13:07.208669 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 509/997] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Aug 5 20:13:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 1313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 20:13:07.210080 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e6f66092-4dfc-4545-9837-cbc71a412073 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:07.210785 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e6f66092-4dfc-4545-9837-cbc71a412073 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:07.279324 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e6f66092-4dfc-4545-9837-cbc71a412073 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:07.286757 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e6f66092-4dfc-4545-9837-cbc71a412073 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481" status: 200 len: 1240 microversion: 2.1 time: 0.080654 Aug 05 20:13:07.287331 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 489/998] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:07 2022] GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:07.353385 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-7f78f37e-5be6-492e-bd31-3b9f0aba7256 req-afe3f805-dba6-4a9d-8c2f-596f8fdc56cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "412b5860-2133-41f8-8960-b3f068a8f11f", "name": "network-vif-deleted", "tag": "0a61f0d0-34bf-488d-a986-3ba8db0d4db6"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:07.371616 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-7f78f37e-5be6-492e-bd31-3b9f0aba7256 req-afe3f805-dba6-4a9d-8c2f-596f8fdc56cb service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:07.372100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-7f78f37e-5be6-492e-bd31-3b9f0aba7256 req-afe3f805-dba6-4a9d-8c2f-596f8fdc56cb service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:07.380767 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-7f78f37e-5be6-492e-bd31-3b9f0aba7256 req-afe3f805-dba6-4a9d-8c2f-596f8fdc56cb service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:07.402670 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-7f78f37e-5be6-492e-bd31-3b9f0aba7256 req-afe3f805-dba6-4a9d-8c2f-596f8fdc56cb service nova] Creating event network-vif-deleted:0a61f0d0-34bf-488d-a986-3ba8db0d4db6 for instance 412b5860-2133-41f8-8960-b3f068a8f11f on hv-cinder-85221 Aug 05 20:13:07.404593 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-5a32401e-0ebc-47d0-b9b3-09cdc153c32e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:07.405838 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-5a32401e-0ebc-47d0-b9b3-09cdc153c32e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:07.413000 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5a32401e-0ebc-47d0-b9b3-09cdc153c32e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:07.413477 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5a32401e-0ebc-47d0-b9b3-09cdc153c32e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:07.413923 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5a32401e-0ebc-47d0-b9b3-09cdc153c32e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:07.414638 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5a32401e-0ebc-47d0-b9b3-09cdc153c32e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:07.415104 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5a32401e-0ebc-47d0-b9b3-09cdc153c32e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:07.415588 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5a32401e-0ebc-47d0-b9b3-09cdc153c32e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:07.416354 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-7f78f37e-5be6-492e-bd31-3b9f0aba7256 req-afe3f805-dba6-4a9d-8c2f-596f8fdc56cb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066746 Aug 05 20:13:07.420263 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 510/999] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:13:07.502352 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-5a32401e-0ebc-47d0-b9b3-09cdc153c32e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:07.510695 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-5a32401e-0ebc-47d0-b9b3-09cdc153c32e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 200 len: 1225 microversion: 2.1 time: 0.119767 Aug 05 20:13:07.511572 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 490/1000] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:07 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 1225 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:08.313070 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a0388803-bc6d-404b-bd8d-83fd3fbd82d2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:08.314446 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a0388803-bc6d-404b-bd8d-83fd3fbd82d2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:08.321542 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a0388803-bc6d-404b-bd8d-83fd3fbd82d2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:08.322039 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a0388803-bc6d-404b-bd8d-83fd3fbd82d2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:08.322482 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a0388803-bc6d-404b-bd8d-83fd3fbd82d2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:08.323186 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a0388803-bc6d-404b-bd8d-83fd3fbd82d2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:08.323652 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a0388803-bc6d-404b-bd8d-83fd3fbd82d2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:08.324084 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a0388803-bc6d-404b-bd8d-83fd3fbd82d2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:08.396237 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a0388803-bc6d-404b-bd8d-83fd3fbd82d2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:08.403815 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a0388803-bc6d-404b-bd8d-83fd3fbd82d2 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481" status: 200 len: 1292 microversion: 2.1 time: 0.098503 Aug 05 20:13:08.404544 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 511/1001] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:08 2022] GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481 => generated 1292 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:08.531334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-24fc813e-0db1-44d0-96e4-5b3c2ce9e04e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:08.531946 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-24fc813e-0db1-44d0-96e4-5b3c2ce9e04e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:08.538298 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24fc813e-0db1-44d0-96e4-5b3c2ce9e04e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:08.538772 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24fc813e-0db1-44d0-96e4-5b3c2ce9e04e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:08.539419 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24fc813e-0db1-44d0-96e4-5b3c2ce9e04e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:08.540224 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24fc813e-0db1-44d0-96e4-5b3c2ce9e04e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:08.540957 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24fc813e-0db1-44d0-96e4-5b3c2ce9e04e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:08.541437 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-24fc813e-0db1-44d0-96e4-5b3c2ce9e04e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:08.556144 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-24fc813e-0db1-44d0-96e4-5b3c2ce9e04e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] HTTP exception thrown: Instance 412b5860-2133-41f8-8960-b3f068a8f11f could not be found. Aug 05 20:13:08.557871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-24fc813e-0db1-44d0-96e4-5b3c2ce9e04e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Request method failure captured: Aug 05 20:13:08.557871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f HTTP/1.1 Aug 05 20:13:08.557871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:13:08.557871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:13:08.557871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:13:08.557871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:13:08.557871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:13:08.557871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:13:08.557871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:13:08.557871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:13:08.557871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XjnN_K-BJc2ooeeA-GjFUZkpe01X2HFLfu4EeNixYoYlQKGhG1Ga_z_gX6AtTffhAVBCBlFM69Bn_lW3GgYTXZVm-uCbgbvM9WIRToIJCUeCq_7gVk8CLPH9jnqkZHCqKZPxnNJ_CXAPAme_CWDTdR8C7T6XJiNHdI-Yr5p4VgPxFY Aug 05 20:13:08.557871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:13:08.557871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:13:08.557871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:13:08.557871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:13:08.557871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:13:08.557871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:13:08.557871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: cd1707d3a6c640b78baeb522cfb7ecdb Aug 05 20:13:08.557871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-TestVolumeBootPattern-1587761633 Aug 05 20:13:08.557871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:13:08.557871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:13:08.559952 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cd1707d3a6c640b78baeb522cfb7ecdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cd1707d3a6c640b78baeb522cfb7ecdb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cd1707d3a6c640b78baeb522cfb7ecdb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cd1707d3a6c640b78baeb522cfb7ecdb", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:13:08.559952 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-TestVolumeBootPattern-1587761633 Aug 05 20:13:08.559952 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: cd1707d3a6c640b78baeb522cfb7ecdb Aug 05 20:13:08.559952 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-TestVolumeBootPattern-1587761633 Aug 05 20:13:08.559952 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-TestVolumeBootPattern-1587761633-project Aug 05 20:13:08.559952 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:13:08.559952 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:13:08.559952 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: b5d959f3af3745ed8e0bc4a67faf34f1 Aug 05 20:13:08.559952 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-TestVolumeBootPattern-1587761633-project Aug 05 20:13:08.559952 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: > Aug 05 20:13:08.559952 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Instance 412b5860-2133-41f8-8960-b3f068a8f11f could not be found. Aug 05 20:13:08.559952 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'id': '412b5860-2133-41f8-8960-b3f068a8f11f'} Aug 05 20:13:08.561805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:13:08.561805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:13:08.561805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:13:08.561805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:13:08.561805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:13:08.561805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:13:08.561805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:13:08.561805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:13:08.561805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:13:08.561805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:13:08.561805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 412b5860-2133-41f8-8960-b3f068a8f11f could not be found. Aug 05 20:13:08.561805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:13:08.561805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:13:08.561805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:13:08.561805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:13:08.561805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:13:08.561805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:13:08.561805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:13:08.561805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:13:08.561805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:13:08.563060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:13:08.563060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:13:08.563060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:13:08.563060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:13:08.563060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:13:08.563060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:13:08.563060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:13:08.563060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 412b5860-2133-41f8-8960-b3f068a8f11f could not be found. Aug 05 20:13:08.563060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:13:08.563060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:13:08.563060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:13:08.563060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:13:08.563060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:13:08.563060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:13:08.563060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:13:08.563060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:13:08.563060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 412b5860-2133-41f8-8960-b3f068a8f11f could not be found. Aug 05 20:13:08.563060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:13:08.565464 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-24fc813e-0db1-44d0-96e4-5b3c2ce9e04e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Returning 404 to user: Instance 412b5860-2133-41f8-8960-b3f068a8f11f could not be found. {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:13:08.565464 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-24fc813e-0db1-44d0-96e4-5b3c2ce9e04e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 404 len: 111 microversion: 2.1 time: 0.031885 Aug 05 20:13:08.565464 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 491/1002] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:08 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:13:08.692278 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-eeee48a6-f4f4-4857-8425-28474f01b3b7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-981127288", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1158990661", "security_groups": [{"name": "tempest-secgroup-smoke-1565201125"}], "block_device_mapping_v2": [{"uuid": "6945fbb8-bc0b-422f-950b-a0d06025315b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9c8ea1a5-5b07-4174-af4e-dcae22583662"}]}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:08.859757 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.network.neutron [None req-eeee48a6-f4f4-4857-8425-28474f01b3b7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] validate_networks() for [('9c8ea1a5-5b07-4174-af4e-dcae22583662', None, None, None, None, None)] {{(pid=118192) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:13:09.425553 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-25e3f5f7-3fd8-427f-ba35-6555f95c5086 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:09.426374 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-25e3f5f7-3fd8-427f-ba35-6555f95c5086 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:09.432494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-25e3f5f7-3fd8-427f-ba35-6555f95c5086 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:09.433022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-25e3f5f7-3fd8-427f-ba35-6555f95c5086 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:09.433483 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-25e3f5f7-3fd8-427f-ba35-6555f95c5086 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:09.434181 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-25e3f5f7-3fd8-427f-ba35-6555f95c5086 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:09.434659 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-25e3f5f7-3fd8-427f-ba35-6555f95c5086 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:09.435080 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-25e3f5f7-3fd8-427f-ba35-6555f95c5086 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:09.518356 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-eeee48a6-f4f4-4857-8425-28474f01b3b7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Flavor limits 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:13:09.518926 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-eeee48a6-f4f4-4857-8425-28474f01b3b7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Image limits 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:13:09.519272 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-eeee48a6-f4f4-4857-8425-28474f01b3b7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Flavor pref 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:13:09.519686 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-eeee48a6-f4f4-4857-8425-28474f01b3b7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Image pref 0:0:0 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:13:09.520114 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.virt.hardware [None req-eeee48a6-f4f4-4857-8425-28474f01b3b7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:13:09.523503 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-25e3f5f7-3fd8-427f-ba35-6555f95c5086 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:09.533464 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eeee48a6-f4f4-4857-8425-28474f01b3b7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:09.534013 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-25e3f5f7-3fd8-427f-ba35-6555f95c5086 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481" status: 200 len: 1298 microversion: 2.1 time: 0.112964 Aug 05 20:13:09.534781 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eeee48a6-f4f4-4857-8425-28474f01b3b7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:09.534967 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eeee48a6-f4f4-4857-8425-28474f01b3b7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:09.535815 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eeee48a6-f4f4-4857-8425-28474f01b3b7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:09.536650 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eeee48a6-f4f4-4857-8425-28474f01b3b7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:09.537389 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eeee48a6-f4f4-4857-8425-28474f01b3b7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:09.545069 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 492/1003] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:09 2022] GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481 => generated 1298 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:13:09.558675 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-eeee48a6-f4f4-4857-8425-28474f01b3b7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Getting quotas for project cd1707d3a6c640b78baeb522cfb7ecdb. Resources: {'cores', 'ram', 'instances'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:13:09.562779 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-eeee48a6-f4f4-4857-8425-28474f01b3b7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Getting quotas for user b5d959f3af3745ed8e0bc4a67faf34f1 and project cd1707d3a6c640b78baeb522cfb7ecdb. Resources: {'cores', 'ram', 'instances'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:13:09.622827 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-eeee48a6-f4f4-4857-8425-28474f01b3b7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Going to run 1 instances... {{(pid=118192) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:13:09.624950 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-eeee48a6-f4f4-4857-8425-28474f01b3b7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: d7407cff-913f-4141-9f0a-619b0e5b0b05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6945fbb8-bc0b-422f-950b-a0d06025315b',volume_size=None,volume_type=None)] {{(pid=118192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:13:09.783962 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-eeee48a6-f4f4-4857-8425-28474f01b3b7 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.096166 Aug 05 20:13:09.790666 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 512/1004] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Aug 5 20:13:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 20:13:09.796234 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e7821d2e-68f0-40db-a313-5fca01d128cd tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:09.796892 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e7821d2e-68f0-40db-a313-5fca01d128cd tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: d7407cff-913f-4141-9f0a-619b0e5b0b05] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:09.887207 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e7821d2e-68f0-40db-a313-5fca01d128cd tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:09.903989 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e7821d2e-68f0-40db-a313-5fca01d128cd tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05" status: 200 len: 1094 microversion: 2.1 time: 0.108928 Aug 05 20:13:09.924045 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 493/1005] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:09 2022] GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05 => generated 1094 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:10.556369 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-08711373-bbd3-484f-a35d-e18ed89466dd tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:10.557338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-08711373-bbd3-484f-a35d-e18ed89466dd tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:10.565509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-08711373-bbd3-484f-a35d-e18ed89466dd tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:10.566005 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-08711373-bbd3-484f-a35d-e18ed89466dd tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:10.566446 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-08711373-bbd3-484f-a35d-e18ed89466dd tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:10.567161 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-08711373-bbd3-484f-a35d-e18ed89466dd tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:10.567624 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-08711373-bbd3-484f-a35d-e18ed89466dd tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:10.568045 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-08711373-bbd3-484f-a35d-e18ed89466dd tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:10.772402 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-08711373-bbd3-484f-a35d-e18ed89466dd tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:10.784775 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-08711373-bbd3-484f-a35d-e18ed89466dd tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481" status: 200 len: 1366 microversion: 2.1 time: 0.232853 Aug 05 20:13:10.789961 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-4863bcab-fe10-409b-b3de-7dda52bccc5f req-dc0360c4-d8bb-4dc9-8e1d-1d9a520ef5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af477044-a719-48b8-a252-17fadffed481", "tag": "989ecd41-305a-4cd0-8309-cff5e919eaca"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:10.796376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 513/1006] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:10 2022] GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:13:10.817105 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-4863bcab-fe10-409b-b3de-7dda52bccc5f req-dc0360c4-d8bb-4dc9-8e1d-1d9a520ef5c8 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:10.817547 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-4863bcab-fe10-409b-b3de-7dda52bccc5f req-dc0360c4-d8bb-4dc9-8e1d-1d9a520ef5c8 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:10.817975 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-4863bcab-fe10-409b-b3de-7dda52bccc5f req-dc0360c4-d8bb-4dc9-8e1d-1d9a520ef5c8 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:10.828557 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-4863bcab-fe10-409b-b3de-7dda52bccc5f req-dc0360c4-d8bb-4dc9-8e1d-1d9a520ef5c8 service nova] Creating event network-changed:989ecd41-305a-4cd0-8309-cff5e919eaca for instance af477044-a719-48b8-a252-17fadffed481 on hv-cinder-85221 Aug 05 20:13:10.834068 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-4863bcab-fe10-409b-b3de-7dda52bccc5f req-dc0360c4-d8bb-4dc9-8e1d-1d9a520ef5c8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047650 Aug 05 20:13:10.834833 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 494/1007] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:13:10.930347 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-747106ed-37b6-481b-9d33-850e6e9ccb84 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:10.930967 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-747106ed-37b6-481b-9d33-850e6e9ccb84 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: d7407cff-913f-4141-9f0a-619b0e5b0b05] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:10.936844 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-747106ed-37b6-481b-9d33-850e6e9ccb84 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:10.937335 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-747106ed-37b6-481b-9d33-850e6e9ccb84 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:10.937774 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-747106ed-37b6-481b-9d33-850e6e9ccb84 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:10.938508 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-747106ed-37b6-481b-9d33-850e6e9ccb84 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:10.939354 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-747106ed-37b6-481b-9d33-850e6e9ccb84 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:10.939992 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-747106ed-37b6-481b-9d33-850e6e9ccb84 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:11.026057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-747106ed-37b6-481b-9d33-850e6e9ccb84 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:11.035158 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-747106ed-37b6-481b-9d33-850e6e9ccb84 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05" status: 200 len: 1200 microversion: 2.1 time: 0.108865 Aug 05 20:13:11.036415 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 514/1008] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:10 2022] GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05 => generated 1200 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:11.822143 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-820867ff-7f56-42d1-b250-c08c17b89076 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:11.822848 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-820867ff-7f56-42d1-b250-c08c17b89076 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:11.829278 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-820867ff-7f56-42d1-b250-c08c17b89076 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:11.830117 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-820867ff-7f56-42d1-b250-c08c17b89076 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:11.830609 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-820867ff-7f56-42d1-b250-c08c17b89076 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:11.831334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-820867ff-7f56-42d1-b250-c08c17b89076 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:11.831787 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-820867ff-7f56-42d1-b250-c08c17b89076 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:11.832222 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-820867ff-7f56-42d1-b250-c08c17b89076 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:11.975897 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-820867ff-7f56-42d1-b250-c08c17b89076 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:11.990217 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-820867ff-7f56-42d1-b250-c08c17b89076 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481" status: 200 len: 1366 microversion: 2.1 time: 0.172578 Aug 05 20:13:11.991251 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 495/1009] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:11 2022] GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:12.056132 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-8e9c3f2c-2243-4fd5-aeb4-87509de3457f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:12.056773 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-8e9c3f2c-2243-4fd5-aeb4-87509de3457f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: d7407cff-913f-4141-9f0a-619b0e5b0b05] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:12.063253 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8e9c3f2c-2243-4fd5-aeb4-87509de3457f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:12.064364 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8e9c3f2c-2243-4fd5-aeb4-87509de3457f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:12.064759 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8e9c3f2c-2243-4fd5-aeb4-87509de3457f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:12.065461 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8e9c3f2c-2243-4fd5-aeb4-87509de3457f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:12.065914 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8e9c3f2c-2243-4fd5-aeb4-87509de3457f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:12.066338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8e9c3f2c-2243-4fd5-aeb4-87509de3457f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:12.202050 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-8e9c3f2c-2243-4fd5-aeb4-87509de3457f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:12.209725 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-8e9c3f2c-2243-4fd5-aeb4-87509de3457f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05" status: 200 len: 1278 microversion: 2.1 time: 0.157413 Aug 05 20:13:12.210298 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 515/1010] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:12 2022] GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:13.012101 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-5ab27d85-1631-457d-bce4-d0848fe34298 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:13.012744 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-5ab27d85-1631-457d-bce4-d0848fe34298 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:13.019863 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5ab27d85-1631-457d-bce4-d0848fe34298 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:13.020349 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5ab27d85-1631-457d-bce4-d0848fe34298 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:13.020831 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5ab27d85-1631-457d-bce4-d0848fe34298 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:13.021580 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5ab27d85-1631-457d-bce4-d0848fe34298 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:13.022059 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5ab27d85-1631-457d-bce4-d0848fe34298 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:13.022479 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5ab27d85-1631-457d-bce4-d0848fe34298 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:13.159829 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-5ab27d85-1631-457d-bce4-d0848fe34298 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:13.167471 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-5ab27d85-1631-457d-bce4-d0848fe34298 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481" status: 200 len: 1366 microversion: 2.1 time: 0.159226 Aug 05 20:13:13.168034 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 496/1011] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:13 2022] GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:13.230239 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-d056e58f-e442-448d-8aa4-b3a442af70bb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:13.230866 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-d056e58f-e442-448d-8aa4-b3a442af70bb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: d7407cff-913f-4141-9f0a-619b0e5b0b05] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:13.238007 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d056e58f-e442-448d-8aa4-b3a442af70bb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:13.238503 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d056e58f-e442-448d-8aa4-b3a442af70bb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:13.238949 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d056e58f-e442-448d-8aa4-b3a442af70bb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:13.239653 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d056e58f-e442-448d-8aa4-b3a442af70bb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:13.240113 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d056e58f-e442-448d-8aa4-b3a442af70bb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:13.240546 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d056e58f-e442-448d-8aa4-b3a442af70bb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:13.382636 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-d056e58f-e442-448d-8aa4-b3a442af70bb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:13.390693 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-d056e58f-e442-448d-8aa4-b3a442af70bb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05" status: 200 len: 1278 microversion: 2.1 time: 0.164273 Aug 05 20:13:13.391278 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 516/1012] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:13 2022] GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05 => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:14.189873 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-60e91cac-5347-4c2d-8638-fd466a46897b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:14.191391 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-60e91cac-5347-4c2d-8638-fd466a46897b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:14.200290 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-60e91cac-5347-4c2d-8638-fd466a46897b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:14.200910 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-60e91cac-5347-4c2d-8638-fd466a46897b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:14.201422 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-60e91cac-5347-4c2d-8638-fd466a46897b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:14.202207 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-60e91cac-5347-4c2d-8638-fd466a46897b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:14.202724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-60e91cac-5347-4c2d-8638-fd466a46897b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:14.203212 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-60e91cac-5347-4c2d-8638-fd466a46897b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:14.242579 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:14.408124 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-02bf1524-1af8-4ac2-b4ce-9d6ce3867df9 req-e944deff-9b9f-4569-a55f-c40db9cfa7ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7407cff-913f-4141-9f0a-619b0e5b0b05", "tag": "e2770287-7121-4b5f-adab-ca922bed34c8"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:14.412233 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-60e91cac-5347-4c2d-8638-fd466a46897b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:14.427658 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-02bf1524-1af8-4ac2-b4ce-9d6ce3867df9 req-e944deff-9b9f-4569-a55f-c40db9cfa7ce service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:14.428657 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-02bf1524-1af8-4ac2-b4ce-9d6ce3867df9 req-e944deff-9b9f-4569-a55f-c40db9cfa7ce service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:14.429270 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-02bf1524-1af8-4ac2-b4ce-9d6ce3867df9 req-e944deff-9b9f-4569-a55f-c40db9cfa7ce service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:14.435127 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-60e91cac-5347-4c2d-8638-fd466a46897b tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481" status: 200 len: 1366 microversion: 2.1 time: 0.249696 Aug 05 20:13:14.435963 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 497/1013] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:14 2022] GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:14.442554 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-b8efb4e2-49b4-45a8-8625-dffa0688345d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:14.443166 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-b8efb4e2-49b4-45a8-8625-dffa0688345d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: d7407cff-913f-4141-9f0a-619b0e5b0b05] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:14.449219 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b8efb4e2-49b4-45a8-8625-dffa0688345d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:14.449894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b8efb4e2-49b4-45a8-8625-dffa0688345d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:14.450517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b8efb4e2-49b4-45a8-8625-dffa0688345d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:14.451412 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b8efb4e2-49b4-45a8-8625-dffa0688345d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:14.451844 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b8efb4e2-49b4-45a8-8625-dffa0688345d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:14.452436 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b8efb4e2-49b4-45a8-8625-dffa0688345d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:14.454461 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-02bf1524-1af8-4ac2-b4ce-9d6ce3867df9 req-e944deff-9b9f-4569-a55f-c40db9cfa7ce service nova] Creating event network-changed:e2770287-7121-4b5f-adab-ca922bed34c8 for instance d7407cff-913f-4141-9f0a-619b0e5b0b05 on hv-cinder-85221 Aug 05 20:13:14.460808 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-02bf1524-1af8-4ac2-b4ce-9d6ce3867df9 req-e944deff-9b9f-4569-a55f-c40db9cfa7ce service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063648 Aug 05 20:13:14.462001 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 517/1014] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:13:14.596711 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-b8efb4e2-49b4-45a8-8625-dffa0688345d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:14.604636 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-b8efb4e2-49b4-45a8-8625-dffa0688345d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05" status: 200 len: 1266 microversion: 2.1 time: 0.167201 Aug 05 20:13:14.605265 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 498/1015] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:14 2022] GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:15.462659 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-c275524e-a21c-4a92-a3ec-df493f89e038 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:15.463353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-c275524e-a21c-4a92-a3ec-df493f89e038 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:15.469975 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c275524e-a21c-4a92-a3ec-df493f89e038 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:15.470473 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c275524e-a21c-4a92-a3ec-df493f89e038 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:15.470909 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c275524e-a21c-4a92-a3ec-df493f89e038 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:15.471609 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c275524e-a21c-4a92-a3ec-df493f89e038 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:15.472059 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c275524e-a21c-4a92-a3ec-df493f89e038 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:15.472682 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c275524e-a21c-4a92-a3ec-df493f89e038 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:15.623584 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-c275524e-a21c-4a92-a3ec-df493f89e038 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:15.627487 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-d7d4b0f8-ecf4-4407-a7db-7a57d107b5bb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:15.629025 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-d7d4b0f8-ecf4-4407-a7db-7a57d107b5bb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: d7407cff-913f-4141-9f0a-619b0e5b0b05] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:15.632830 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-c275524e-a21c-4a92-a3ec-df493f89e038 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481" status: 200 len: 1366 microversion: 2.1 time: 0.174748 Aug 05 20:13:15.633421 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 518/1016] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:15 2022] GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:15.645417 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d7d4b0f8-ecf4-4407-a7db-7a57d107b5bb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:15.646002 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d7d4b0f8-ecf4-4407-a7db-7a57d107b5bb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:15.646514 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d7d4b0f8-ecf4-4407-a7db-7a57d107b5bb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:15.647294 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d7d4b0f8-ecf4-4407-a7db-7a57d107b5bb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:15.647997 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d7d4b0f8-ecf4-4407-a7db-7a57d107b5bb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:15.648369 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d7d4b0f8-ecf4-4407-a7db-7a57d107b5bb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:15.790459 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-d7d4b0f8-ecf4-4407-a7db-7a57d107b5bb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:15.799545 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-d7d4b0f8-ecf4-4407-a7db-7a57d107b5bb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05" status: 200 len: 1266 microversion: 2.1 time: 0.176615 Aug 05 20:13:15.800142 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 499/1017] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:15 2022] GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:13:15.904068 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-92d066b3-b7ae-4fe2-8e9f-1a609a7e61fc tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:15.904904 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-92d066b3-b7ae-4fe2-8e9f-1a609a7e61fc tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:15.912246 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-92d066b3-b7ae-4fe2-8e9f-1a609a7e61fc tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:15.912817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-92d066b3-b7ae-4fe2-8e9f-1a609a7e61fc tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:15.913259 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-92d066b3-b7ae-4fe2-8e9f-1a609a7e61fc tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:15.913976 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-92d066b3-b7ae-4fe2-8e9f-1a609a7e61fc tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:15.914633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-92d066b3-b7ae-4fe2-8e9f-1a609a7e61fc tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:15.915061 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-92d066b3-b7ae-4fe2-8e9f-1a609a7e61fc tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:15.919685 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:15.947450 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-92d066b3-b7ae-4fe2-8e9f-1a609a7e61fc tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Going to try to terminate instance {{(pid=118192) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:13:16.045138 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-92d066b3-b7ae-4fe2-8e9f-1a609a7e61fc tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 204 len: 0 microversion: 2.1 time: 0.144629 Aug 05 20:13:16.050451 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 519/1018] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:13:15 2022] DELETE /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:13:16.055966 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3e8378ef-84c9-487e-840d-28d4fd96a99a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:16.056595 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-3e8378ef-84c9-487e-840d-28d4fd96a99a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:16.065453 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e8378ef-84c9-487e-840d-28d4fd96a99a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:16.065951 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e8378ef-84c9-487e-840d-28d4fd96a99a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:16.066390 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e8378ef-84c9-487e-840d-28d4fd96a99a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:16.067108 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e8378ef-84c9-487e-840d-28d4fd96a99a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:16.067562 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e8378ef-84c9-487e-840d-28d4fd96a99a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:16.070310 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e8378ef-84c9-487e-840d-28d4fd96a99a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:16.215290 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3e8378ef-84c9-487e-840d-28d4fd96a99a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:16.223765 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3e8378ef-84c9-487e-840d-28d4fd96a99a tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1567 microversion: 2.1 time: 0.172019 Aug 05 20:13:16.224360 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 500/1019] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:16 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:16.486713 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-d431fe1b-12d6-477c-b1aa-8fd4c02207c3 req-e51a2142-630c-455d-bbbd-f44eacb94aeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5559da3c-05e6-432d-960c-67c53284cc54", "tag": "5e5897da-174c-4054-8f66-ed7648322749"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:16.493418 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3,nova_api:INSERT=7 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:16.498092 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-d431fe1b-12d6-477c-b1aa-8fd4c02207c3 req-e51a2142-630c-455d-bbbd-f44eacb94aeb service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:16.498576 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-d431fe1b-12d6-477c-b1aa-8fd4c02207c3 req-e51a2142-630c-455d-bbbd-f44eacb94aeb service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:16.499012 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-d431fe1b-12d6-477c-b1aa-8fd4c02207c3 req-e51a2142-630c-455d-bbbd-f44eacb94aeb service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:16.512219 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-d431fe1b-12d6-477c-b1aa-8fd4c02207c3 req-e51a2142-630c-455d-bbbd-f44eacb94aeb service nova] Creating event network-changed:5e5897da-174c-4054-8f66-ed7648322749 for instance 5559da3c-05e6-432d-960c-67c53284cc54 on hv-cinder-85221 Aug 05 20:13:16.518541 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-d431fe1b-12d6-477c-b1aa-8fd4c02207c3 req-e51a2142-630c-455d-bbbd-f44eacb94aeb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035841 Aug 05 20:13:16.518987 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 520/1020] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:13:16.654580 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-4a22a499-b1d7-414a-8cbd-b5469a6a1512 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:16.655303 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-4a22a499-b1d7-414a-8cbd-b5469a6a1512 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:16.662150 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4a22a499-b1d7-414a-8cbd-b5469a6a1512 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:16.662635 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4a22a499-b1d7-414a-8cbd-b5469a6a1512 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:16.663069 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4a22a499-b1d7-414a-8cbd-b5469a6a1512 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:16.663885 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4a22a499-b1d7-414a-8cbd-b5469a6a1512 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:16.664394 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4a22a499-b1d7-414a-8cbd-b5469a6a1512 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:16.664784 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4a22a499-b1d7-414a-8cbd-b5469a6a1512 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:16.815294 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-4a22a499-b1d7-414a-8cbd-b5469a6a1512 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:16.821484 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-89d9c7bb-2442-4be1-9735-022f23efe292 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:16.822317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-89d9c7bb-2442-4be1-9735-022f23efe292 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: d7407cff-913f-4141-9f0a-619b0e5b0b05] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:16.823185 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-4a22a499-b1d7-414a-8cbd-b5469a6a1512 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481" status: 200 len: 1366 microversion: 2.1 time: 0.172352 Aug 05 20:13:16.837468 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 501/1021] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:16 2022] GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:16.837723 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-89d9c7bb-2442-4be1-9735-022f23efe292 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:16.837723 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-89d9c7bb-2442-4be1-9735-022f23efe292 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:16.837723 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-89d9c7bb-2442-4be1-9735-022f23efe292 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:16.837723 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-89d9c7bb-2442-4be1-9735-022f23efe292 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:16.838133 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-89d9c7bb-2442-4be1-9735-022f23efe292 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:16.838133 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-89d9c7bb-2442-4be1-9735-022f23efe292 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:16.969163 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-89d9c7bb-2442-4be1-9735-022f23efe292 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:16.977640 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-89d9c7bb-2442-4be1-9735-022f23efe292 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05" status: 200 len: 1266 microversion: 2.1 time: 0.161756 Aug 05 20:13:16.978222 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 521/1022] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:16 2022] GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:13:17.245676 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-0066bdcb-b6cf-4fd5-a115-7c22b573cbac tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:17.246259 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-0066bdcb-b6cf-4fd5-a115-7c22b573cbac tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:17.253639 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0066bdcb-b6cf-4fd5-a115-7c22b573cbac tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:17.254138 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0066bdcb-b6cf-4fd5-a115-7c22b573cbac tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:17.254570 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0066bdcb-b6cf-4fd5-a115-7c22b573cbac tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:17.255269 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0066bdcb-b6cf-4fd5-a115-7c22b573cbac tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:17.255722 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0066bdcb-b6cf-4fd5-a115-7c22b573cbac tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:17.256150 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0066bdcb-b6cf-4fd5-a115-7c22b573cbac tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:17.418383 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-0066bdcb-b6cf-4fd5-a115-7c22b573cbac tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:17.433714 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-0066bdcb-b6cf-4fd5-a115-7c22b573cbac tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1567 microversion: 2.1 time: 0.192436 Aug 05 20:13:17.435392 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 502/1023] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:17 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:17.621799 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-b95899be-eeef-4c54-964b-5476c1419cf4 req-103cd66a-ab24-4f79-a8de-902acd65bd14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af477044-a719-48b8-a252-17fadffed481", "name": "network-vif-plugged", "status": "completed", "tag": "989ecd41-305a-4cd0-8309-cff5e919eaca"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:17.635731 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-b95899be-eeef-4c54-964b-5476c1419cf4 req-103cd66a-ab24-4f79-a8de-902acd65bd14 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:17.636348 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-b95899be-eeef-4c54-964b-5476c1419cf4 req-103cd66a-ab24-4f79-a8de-902acd65bd14 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:17.636895 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-b95899be-eeef-4c54-964b-5476c1419cf4 req-103cd66a-ab24-4f79-a8de-902acd65bd14 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:17.650281 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-b95899be-eeef-4c54-964b-5476c1419cf4 req-103cd66a-ab24-4f79-a8de-902acd65bd14 service nova] Creating event network-vif-plugged:989ecd41-305a-4cd0-8309-cff5e919eaca for instance af477044-a719-48b8-a252-17fadffed481 on hv-cinder-85221 Aug 05 20:13:17.655792 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-b95899be-eeef-4c54-964b-5476c1419cf4 req-103cd66a-ab24-4f79-a8de-902acd65bd14 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038688 Aug 05 20:13:17.656646 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 522/1024] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:13:17.844554 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-8d2c8b12-3622-43d1-a16d-b3a36d6dff98 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:17.845346 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-8d2c8b12-3622-43d1-a16d-b3a36d6dff98 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:17.851867 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8d2c8b12-3622-43d1-a16d-b3a36d6dff98 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:17.852361 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8d2c8b12-3622-43d1-a16d-b3a36d6dff98 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:17.852825 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8d2c8b12-3622-43d1-a16d-b3a36d6dff98 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:17.853529 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8d2c8b12-3622-43d1-a16d-b3a36d6dff98 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:17.853986 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8d2c8b12-3622-43d1-a16d-b3a36d6dff98 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:17.854415 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8d2c8b12-3622-43d1-a16d-b3a36d6dff98 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:17.999893 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-2d0c66ea-28f4-422b-af9d-23e01ed97b4c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:18.000852 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-2d0c66ea-28f4-422b-af9d-23e01ed97b4c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: d7407cff-913f-4141-9f0a-619b0e5b0b05] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:18.008065 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2d0c66ea-28f4-422b-af9d-23e01ed97b4c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:18.008696 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2d0c66ea-28f4-422b-af9d-23e01ed97b4c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:18.009200 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2d0c66ea-28f4-422b-af9d-23e01ed97b4c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:18.009972 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2d0c66ea-28f4-422b-af9d-23e01ed97b4c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:18.010618 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2d0c66ea-28f4-422b-af9d-23e01ed97b4c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:18.011137 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2d0c66ea-28f4-422b-af9d-23e01ed97b4c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:18.412324 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-2d0c66ea-28f4-422b-af9d-23e01ed97b4c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:18.419890 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-2d0c66ea-28f4-422b-af9d-23e01ed97b4c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05" status: 200 len: 1266 microversion: 2.1 time: 0.424363 Aug 05 20:13:18.420804 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 523/1025] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:17 2022] GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05 => generated 1266 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:13:18.423599 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8d2c8b12-3622-43d1-a16d-b3a36d6dff98 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:18.431478 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-8d2c8b12-3622-43d1-a16d-b3a36d6dff98 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481" status: 200 len: 1366 microversion: 2.1 time: 0.590842 Aug 05 20:13:18.432059 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 503/1026] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:17 2022] GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481 => generated 1366 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:18.457726 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-bc621090-2ccb-42b1-b117-79f1f664aa25 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:18.458340 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-bc621090-2ccb-42b1-b117-79f1f664aa25 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:18.464295 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-bc621090-2ccb-42b1-b117-79f1f664aa25 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:18.464817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-bc621090-2ccb-42b1-b117-79f1f664aa25 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:18.465254 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-bc621090-2ccb-42b1-b117-79f1f664aa25 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:18.465941 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-bc621090-2ccb-42b1-b117-79f1f664aa25 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:18.466395 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-bc621090-2ccb-42b1-b117-79f1f664aa25 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:18.466812 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-bc621090-2ccb-42b1-b117-79f1f664aa25 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:18.603457 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-bc621090-2ccb-42b1-b117-79f1f664aa25 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:18.611285 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-bc621090-2ccb-42b1-b117-79f1f664aa25 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1567 microversion: 2.1 time: 0.158049 Aug 05 20:13:18.611857 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 524/1027] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:18 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:19.337047 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-195a8a1a-7fd5-4a00-bd25-7c1a79d4c7c3 req-b8737fa4-d625-4858-a6d4-1b76f7fdf6ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5559da3c-05e6-432d-960c-67c53284cc54", "name": "network-vif-deleted", "tag": "5e5897da-174c-4054-8f66-ed7648322749"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:19.342509 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:19.348843 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-195a8a1a-7fd5-4a00-bd25-7c1a79d4c7c3 req-b8737fa4-d625-4858-a6d4-1b76f7fdf6ea service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:19.349355 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-195a8a1a-7fd5-4a00-bd25-7c1a79d4c7c3 req-b8737fa4-d625-4858-a6d4-1b76f7fdf6ea service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:19.349783 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-195a8a1a-7fd5-4a00-bd25-7c1a79d4c7c3 req-b8737fa4-d625-4858-a6d4-1b76f7fdf6ea service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:19.362873 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-195a8a1a-7fd5-4a00-bd25-7c1a79d4c7c3 req-b8737fa4-d625-4858-a6d4-1b76f7fdf6ea service nova] Creating event network-vif-deleted:5e5897da-174c-4054-8f66-ed7648322749 for instance 5559da3c-05e6-432d-960c-67c53284cc54 on hv-cinder-85221 Aug 05 20:13:19.367846 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-195a8a1a-7fd5-4a00-bd25-7c1a79d4c7c3 req-b8737fa4-d625-4858-a6d4-1b76f7fdf6ea service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034532 Aug 05 20:13:19.368435 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 504/1028] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:13:19.441428 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-f3576c7d-db8d-4ae4-813f-2509e4a1c6b5 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:19.442047 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-f3576c7d-db8d-4ae4-813f-2509e4a1c6b5 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: d7407cff-913f-4141-9f0a-619b0e5b0b05] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:19.448545 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f3576c7d-db8d-4ae4-813f-2509e4a1c6b5 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:19.449079 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f3576c7d-db8d-4ae4-813f-2509e4a1c6b5 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:19.449517 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f3576c7d-db8d-4ae4-813f-2509e4a1c6b5 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:19.450217 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f3576c7d-db8d-4ae4-813f-2509e4a1c6b5 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:19.450672 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f3576c7d-db8d-4ae4-813f-2509e4a1c6b5 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:19.451101 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f3576c7d-db8d-4ae4-813f-2509e4a1c6b5 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:19.451979 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-20805e3a-ec3c-4688-9f2b-6b9d2ab9dfea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:19.452707 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-20805e3a-ec3c-4688-9f2b-6b9d2ab9dfea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:19.459286 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-20805e3a-ec3c-4688-9f2b-6b9d2ab9dfea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:19.459806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-20805e3a-ec3c-4688-9f2b-6b9d2ab9dfea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:19.460246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-20805e3a-ec3c-4688-9f2b-6b9d2ab9dfea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:19.460962 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-20805e3a-ec3c-4688-9f2b-6b9d2ab9dfea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:19.461411 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-20805e3a-ec3c-4688-9f2b-6b9d2ab9dfea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:19.461831 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-20805e3a-ec3c-4688-9f2b-6b9d2ab9dfea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:19.549135 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell0:SELECT=4 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:19.569354 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell0:SELECT=16 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:19.738013 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-20805e3a-ec3c-4688-9f2b-6b9d2ab9dfea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:19.747014 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-20805e3a-ec3c-4688-9f2b-6b9d2ab9dfea tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481" status: 200 len: 1366 microversion: 2.1 time: 0.298963 Aug 05 20:13:19.756369 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 505/1029] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:19 2022] GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:13:19.756369 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-8bd96f4c-6816-424c-a98c-5fcb79a3b667 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:19.757360 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-8bd96f4c-6816-424c-a98c-5fcb79a3b667 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:19.764881 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-f3576c7d-db8d-4ae4-813f-2509e4a1c6b5 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:19.768077 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8bd96f4c-6816-424c-a98c-5fcb79a3b667 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:19.769255 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8bd96f4c-6816-424c-a98c-5fcb79a3b667 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:19.769255 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8bd96f4c-6816-424c-a98c-5fcb79a3b667 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:19.769961 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8bd96f4c-6816-424c-a98c-5fcb79a3b667 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:19.770421 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8bd96f4c-6816-424c-a98c-5fcb79a3b667 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:19.770858 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8bd96f4c-6816-424c-a98c-5fcb79a3b667 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:19.773931 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-f3576c7d-db8d-4ae4-813f-2509e4a1c6b5 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05" status: 200 len: 1266 microversion: 2.1 time: 0.336871 Aug 05 20:13:19.774519 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 525/1030] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:19 2022] GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05 => generated 1266 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:19.845508 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8bd96f4c-6816-424c-a98c-5fcb79a3b667 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:19.855097 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-8bd96f4c-6816-424c-a98c-5fcb79a3b667 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1219 microversion: 2.1 time: 0.105344 Aug 05 20:13:19.855690 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 506/1031] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:19 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:20.771646 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-060c64e8-e673-40d6-899a-aa80505d2464 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:20.772479 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-060c64e8-e673-40d6-899a-aa80505d2464 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:20.780422 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-060c64e8-e673-40d6-899a-aa80505d2464 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:20.781061 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-060c64e8-e673-40d6-899a-aa80505d2464 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:20.781834 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-060c64e8-e673-40d6-899a-aa80505d2464 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:20.783467 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-060c64e8-e673-40d6-899a-aa80505d2464 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:20.784012 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-060c64e8-e673-40d6-899a-aa80505d2464 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:20.784717 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-060c64e8-e673-40d6-899a-aa80505d2464 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:20.793986 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=4 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:20.799684 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-6b11082a-b024-4fdf-b982-de87d3d49d66 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:20.800407 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-6b11082a-b024-4fdf-b982-de87d3d49d66 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: d7407cff-913f-4141-9f0a-619b0e5b0b05] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:20.807008 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6b11082a-b024-4fdf-b982-de87d3d49d66 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:20.807498 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6b11082a-b024-4fdf-b982-de87d3d49d66 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:20.809041 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6b11082a-b024-4fdf-b982-de87d3d49d66 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:20.809041 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6b11082a-b024-4fdf-b982-de87d3d49d66 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:20.809275 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6b11082a-b024-4fdf-b982-de87d3d49d66 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:20.809593 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6b11082a-b024-4fdf-b982-de87d3d49d66 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:21.039011 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-060c64e8-e673-40d6-899a-aa80505d2464 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:21.047858 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-060c64e8-e673-40d6-899a-aa80505d2464 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481" status: 200 len: 1556 microversion: 2.1 time: 0.281467 Aug 05 20:13:21.048000 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 526/1032] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:20 2022] GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481 => generated 1556 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:21.049521 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-6b11082a-b024-4fdf-b982-de87d3d49d66 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:21.055620 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-87eb5904-2648-4d52-a963-2b04017cd7b5 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:21.056639 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-87eb5904-2648-4d52-a963-2b04017cd7b5 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:21.057779 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-6b11082a-b024-4fdf-b982-de87d3d49d66 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05" status: 200 len: 1266 microversion: 2.1 time: 0.266136 Aug 05 20:13:21.058676 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 507/1033] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:20 2022] GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05 => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:13:21.064150 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-87eb5904-2648-4d52-a963-2b04017cd7b5 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:21.065114 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-87eb5904-2648-4d52-a963-2b04017cd7b5 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:21.065679 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-87eb5904-2648-4d52-a963-2b04017cd7b5 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:21.066476 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-87eb5904-2648-4d52-a963-2b04017cd7b5 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:21.067035 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-87eb5904-2648-4d52-a963-2b04017cd7b5 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:21.067537 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-87eb5904-2648-4d52-a963-2b04017cd7b5 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:21.076400 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-ce527ed8-76bb-464b-b7f7-b33c871ce61c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:21.076934 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-ce527ed8-76bb-464b-b7f7-b33c871ce61c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:21.086677 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ce527ed8-76bb-464b-b7f7-b33c871ce61c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:21.087178 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ce527ed8-76bb-464b-b7f7-b33c871ce61c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:21.087626 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ce527ed8-76bb-464b-b7f7-b33c871ce61c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:21.088353 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ce527ed8-76bb-464b-b7f7-b33c871ce61c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:21.088845 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ce527ed8-76bb-464b-b7f7-b33c871ce61c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:21.089501 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ce527ed8-76bb-464b-b7f7-b33c871ce61c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:21.109773 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-87eb5904-2648-4d52-a963-2b04017cd7b5 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:21.110263 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-87eb5904-2648-4d52-a963-2b04017cd7b5 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:21.110828 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-87eb5904-2648-4d52-a963-2b04017cd7b5 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:21.111324 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.objects.instance [None req-87eb5904-2648-4d52-a963-2b04017cd7b5 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lazy-loading 'fault' on Instance uuid 5559da3c-05e6-432d-960c-67c53284cc54 {{(pid=118192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:13:21.194818 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-87eb5904-2648-4d52-a963-2b04017cd7b5 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:21.202332 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-87eb5904-2648-4d52-a963-2b04017cd7b5 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1387 microversion: 2.1 time: 0.152408 Aug 05 20:13:21.202901 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 527/1034] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:21 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1387 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:21.208971 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-ce527ed8-76bb-464b-b7f7-b33c871ce61c tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.136456 Aug 05 20:13:21.209560 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 508/1035] 10.222.0.39 () {58 vars in 1275 bytes} [Fri Aug 5 20:13:21 2022] GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:13:22.083669 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-2dbee878-fd2a-40c3-a06d-242eecce2025 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:22.084285 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-2dbee878-fd2a-40c3-a06d-242eecce2025 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: d7407cff-913f-4141-9f0a-619b0e5b0b05] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:22.090805 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2dbee878-fd2a-40c3-a06d-242eecce2025 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:22.091301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2dbee878-fd2a-40c3-a06d-242eecce2025 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:22.091745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2dbee878-fd2a-40c3-a06d-242eecce2025 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:22.092451 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2dbee878-fd2a-40c3-a06d-242eecce2025 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:22.092980 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2dbee878-fd2a-40c3-a06d-242eecce2025 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:22.093413 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2dbee878-fd2a-40c3-a06d-242eecce2025 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:22.225050 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-8053d189-dbeb-4814-aa68-037511ffad04 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:22.225814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-8053d189-dbeb-4814-aa68-037511ffad04 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:22.231957 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8053d189-dbeb-4814-aa68-037511ffad04 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:22.232441 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8053d189-dbeb-4814-aa68-037511ffad04 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:22.232899 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8053d189-dbeb-4814-aa68-037511ffad04 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:22.233589 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8053d189-dbeb-4814-aa68-037511ffad04 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:22.234561 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8053d189-dbeb-4814-aa68-037511ffad04 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:22.234996 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8053d189-dbeb-4814-aa68-037511ffad04 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:22.277089 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8053d189-dbeb-4814-aa68-037511ffad04 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:22.277785 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8053d189-dbeb-4814-aa68-037511ffad04 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:22.278396 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8053d189-dbeb-4814-aa68-037511ffad04 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:22.278849 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.objects.instance [None req-8053d189-dbeb-4814-aa68-037511ffad04 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lazy-loading 'fault' on Instance uuid 5559da3c-05e6-432d-960c-67c53284cc54 {{(pid=118191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:13:22.296411 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-2dbee878-fd2a-40c3-a06d-242eecce2025 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:22.305545 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-2dbee878-fd2a-40c3-a06d-242eecce2025 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05" status: 200 len: 1266 microversion: 2.1 time: 0.225767 Aug 05 20:13:22.307082 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 528/1036] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:22 2022] GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:22.331187 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8053d189-dbeb-4814-aa68-037511ffad04 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e022456457d41b8812058252e4a43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8a529448f14ef18a72de884f17d0f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:22.340153 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-8053d189-dbeb-4814-aa68-037511ffad04 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 200 len: 1387 microversion: 2.1 time: 0.120615 Aug 05 20:13:22.340778 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 509/1037] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:22 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 1387 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:13:22.386794 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-5be901f0-716a-4158-af59-6d04da81e81d req-d3f14ceb-72a3-4782-89ba-3efe58d56bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af477044-a719-48b8-a252-17fadffed481", "tag": "989ecd41-305a-4cd0-8309-cff5e919eaca"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:22.403212 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-5be901f0-716a-4158-af59-6d04da81e81d req-d3f14ceb-72a3-4782-89ba-3efe58d56bb4 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:22.403788 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-5be901f0-716a-4158-af59-6d04da81e81d req-d3f14ceb-72a3-4782-89ba-3efe58d56bb4 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:22.404287 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-5be901f0-716a-4158-af59-6d04da81e81d req-d3f14ceb-72a3-4782-89ba-3efe58d56bb4 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:22.417708 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-5be901f0-716a-4158-af59-6d04da81e81d req-d3f14ceb-72a3-4782-89ba-3efe58d56bb4 service nova] Creating event network-changed:989ecd41-305a-4cd0-8309-cff5e919eaca for instance af477044-a719-48b8-a252-17fadffed481 on hv-cinder-85221 Aug 05 20:13:22.422862 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-5be901f0-716a-4158-af59-6d04da81e81d req-d3f14ceb-72a3-4782-89ba-3efe58d56bb4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114385 Aug 05 20:13:22.423796 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 529/1038] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:13:23.326570 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3c08cfec-8d36-403b-8506-271f91c636c1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:23.327545 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-3c08cfec-8d36-403b-8506-271f91c636c1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: d7407cff-913f-4141-9f0a-619b0e5b0b05] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:23.334394 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3c08cfec-8d36-403b-8506-271f91c636c1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:23.334879 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3c08cfec-8d36-403b-8506-271f91c636c1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:23.335312 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3c08cfec-8d36-403b-8506-271f91c636c1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:23.336004 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3c08cfec-8d36-403b-8506-271f91c636c1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:23.336452 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3c08cfec-8d36-403b-8506-271f91c636c1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:23.336909 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3c08cfec-8d36-403b-8506-271f91c636c1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:23.364450 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a4994065-15c7-407b-8d75-7d1124357c04 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:23.366066 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a4994065-15c7-407b-8d75-7d1124357c04 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] [instance: 5559da3c-05e6-432d-960c-67c53284cc54] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:23.396946 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a4994065-15c7-407b-8d75-7d1124357c04 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:23.397712 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a4994065-15c7-407b-8d75-7d1124357c04 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:23.398242 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a4994065-15c7-407b-8d75-7d1124357c04 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:23.399441 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a4994065-15c7-407b-8d75-7d1124357c04 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:23.400127 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a4994065-15c7-407b-8d75-7d1124357c04 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:23.401279 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a4994065-15c7-407b-8d75-7d1124357c04 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:23.419345 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-a4994065-15c7-407b-8d75-7d1124357c04 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] HTTP exception thrown: Instance 5559da3c-05e6-432d-960c-67c53284cc54 could not be found. Aug 05 20:13:23.421417 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a4994065-15c7-407b-8d75-7d1124357c04 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Request method failure captured: Aug 05 20:13:23.421417 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 HTTP/1.1 Aug 05 20:13:23.421417 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:13:23.421417 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:13:23.421417 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:13:23.421417 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 0 Aug 05 20:13:23.421417 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:13:23.421417 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:13:23.421417 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:13:23.421417 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:13:23.421417 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XgPVcmpDKoxLfQcdFk1iHAwTLELkgBKgk3PRRukilJEhuw10hfyqBBTztDSdg7zgUrDuORzM6XSXMhW22AbJJQpN-6YlEwBsE_g-J6IyJTCU7jSx6XlFSk4fuGgRPJCshjkydTYqHfDNB8JqeGpYdqfFhEWim-ZnTrTzzr_IAgT4cQ Aug 05 20:13:23.421417 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:13:23.421417 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:13:23.421417 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:13:23.421417 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:13:23.421417 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:13:23.421417 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:13:23.421417 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: 3f8a529448f14ef18a72de884f17d0f6 Aug 05 20:13:23.421417 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-TestShelveInstance-830781234 Aug 05 20:13:23.421417 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:13:23.421417 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:13:23.423830 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3f8a529448f14ef18a72de884f17d0f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3f8a529448f14ef18a72de884f17d0f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3f8a529448f14ef18a72de884f17d0f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3f8a529448f14ef18a72de884f17d0f6", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:13:23.423830 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-TestShelveInstance-830781234 Aug 05 20:13:23.423830 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: 3f8a529448f14ef18a72de884f17d0f6 Aug 05 20:13:23.423830 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-TestShelveInstance-830781234 Aug 05 20:13:23.423830 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-TestShelveInstance-830781234-project Aug 05 20:13:23.423830 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:13:23.423830 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:13:23.423830 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: 0e022456457d41b8812058252e4a43f4 Aug 05 20:13:23.423830 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-TestShelveInstance-830781234-project Aug 05 20:13:23.423830 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: > Aug 05 20:13:23.423830 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Instance 5559da3c-05e6-432d-960c-67c53284cc54 could not be found. Aug 05 20:13:23.423830 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'id': '5559da3c-05e6-432d-960c-67c53284cc54'} Aug 05 20:13:23.425376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:13:23.425376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:13:23.425376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:13:23.425376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:13:23.425376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:13:23.425376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:13:23.425376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:13:23.425376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:13:23.425376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:13:23.425376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:13:23.425376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5559da3c-05e6-432d-960c-67c53284cc54 could not be found. Aug 05 20:13:23.425376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:13:23.425376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:13:23.425376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:13:23.425376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:13:23.425376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:13:23.425376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:13:23.425376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:13:23.425376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:13:23.425376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:13:23.428249 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:13:23.428249 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:13:23.428249 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:13:23.428249 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:13:23.428249 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:13:23.428249 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:13:23.428249 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:13:23.428249 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5559da3c-05e6-432d-960c-67c53284cc54 could not be found. Aug 05 20:13:23.428249 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:13:23.428249 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:13:23.428249 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:13:23.428249 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:13:23.428249 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:13:23.428249 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:13:23.428249 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:13:23.428249 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:13:23.428249 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5559da3c-05e6-432d-960c-67c53284cc54 could not be found. Aug 05 20:13:23.428249 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:13:23.432838 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a4994065-15c7-407b-8d75-7d1124357c04 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Returning 404 to user: Instance 5559da3c-05e6-432d-960c-67c53284cc54 could not be found. {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:13:23.432838 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a4994065-15c7-407b-8d75-7d1124357c04 tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54" status: 404 len: 111 microversion: 2.1 time: 0.073383 Aug 05 20:13:23.432838 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 530/1039] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:23 2022] GET /compute/v2.1/servers/5559da3c-05e6-432d-960c-67c53284cc54 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 20:13:23.497002 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3c08cfec-8d36-403b-8506-271f91c636c1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:23.508135 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3c08cfec-8d36-403b-8506-271f91c636c1 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05" status: 200 len: 1266 microversion: 2.1 time: 0.185318 Aug 05 20:13:23.508975 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 510/1040] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:23 2022] GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:23.625249 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-c7d0b271-627d-4b75-bf08-1d968f005cdf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] Calling method '.version_select at 0x7fe3e4548280>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:23.646139 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-c7d0b271-627d-4b75-bf08-1d968f005cdf tempest-TestShelveInstance-830781234 tempest-TestShelveInstance-830781234-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1038104014" status: 202 len: 0 microversion: 2.1 time: 0.024995 Aug 05 20:13:23.646726 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 531/1041] 10.222.0.39 () {58 vars in 1254 bytes} [Fri Aug 5 20:13:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1038104014 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:13:24.528995 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-fc41090a-865b-434e-8414-0ce0d478d22a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:24.529625 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-fc41090a-865b-434e-8414-0ce0d478d22a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: d7407cff-913f-4141-9f0a-619b0e5b0b05] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:24.536391 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc41090a-865b-434e-8414-0ce0d478d22a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:24.536924 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc41090a-865b-434e-8414-0ce0d478d22a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:24.537365 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc41090a-865b-434e-8414-0ce0d478d22a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:24.538064 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc41090a-865b-434e-8414-0ce0d478d22a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:24.538698 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc41090a-865b-434e-8414-0ce0d478d22a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:24.539124 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc41090a-865b-434e-8414-0ce0d478d22a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:24.761323 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-fc41090a-865b-434e-8414-0ce0d478d22a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:24.769258 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-fc41090a-865b-434e-8414-0ce0d478d22a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05" status: 200 len: 1266 microversion: 2.1 time: 0.244080 Aug 05 20:13:24.769832 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 511/1042] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:24 2022] GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:25.653806 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-cb5b6a05-aa41-4adf-ae30-26c3ee026dd4 req-7e950edf-79fe-43d3-8504-89c38aab8d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7407cff-913f-4141-9f0a-619b0e5b0b05", "name": "network-vif-plugged", "status": "completed", "tag": "e2770287-7121-4b5f-adab-ca922bed34c8"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:25.669404 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-cb5b6a05-aa41-4adf-ae30-26c3ee026dd4 req-7e950edf-79fe-43d3-8504-89c38aab8d85 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:25.670290 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-cb5b6a05-aa41-4adf-ae30-26c3ee026dd4 req-7e950edf-79fe-43d3-8504-89c38aab8d85 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:25.671088 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-cb5b6a05-aa41-4adf-ae30-26c3ee026dd4 req-7e950edf-79fe-43d3-8504-89c38aab8d85 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:25.683565 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-cb5b6a05-aa41-4adf-ae30-26c3ee026dd4 req-7e950edf-79fe-43d3-8504-89c38aab8d85 service nova] Creating event network-vif-plugged:e2770287-7121-4b5f-adab-ca922bed34c8 for instance d7407cff-913f-4141-9f0a-619b0e5b0b05 on hv-cinder-85221 Aug 05 20:13:25.688941 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-cb5b6a05-aa41-4adf-ae30-26c3ee026dd4 req-7e950edf-79fe-43d3-8504-89c38aab8d85 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040025 Aug 05 20:13:25.690044 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 532/1043] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:13:25.790141 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9c5ec0bb-a964-443e-9d3f-96e80a04b9f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:25.791492 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-9c5ec0bb-a964-443e-9d3f-96e80a04b9f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: d7407cff-913f-4141-9f0a-619b0e5b0b05] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:25.799115 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9c5ec0bb-a964-443e-9d3f-96e80a04b9f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:25.799742 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9c5ec0bb-a964-443e-9d3f-96e80a04b9f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:25.800447 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9c5ec0bb-a964-443e-9d3f-96e80a04b9f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:25.801723 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9c5ec0bb-a964-443e-9d3f-96e80a04b9f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:25.802222 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9c5ec0bb-a964-443e-9d3f-96e80a04b9f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:25.802776 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9c5ec0bb-a964-443e-9d3f-96e80a04b9f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:26.100056 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9c5ec0bb-a964-443e-9d3f-96e80a04b9f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:26.109170 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-9c5ec0bb-a964-443e-9d3f-96e80a04b9f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05" status: 200 len: 1266 microversion: 2.1 time: 0.322851 Aug 05 20:13:26.111149 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 512/1044] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:25 2022] GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05 => generated 1266 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:27.135245 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-29f85b84-14db-4643-8efe-271a356f6265 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:27.137150 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-29f85b84-14db-4643-8efe-271a356f6265 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: d7407cff-913f-4141-9f0a-619b0e5b0b05] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:27.153124 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-29f85b84-14db-4643-8efe-271a356f6265 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:27.153905 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-29f85b84-14db-4643-8efe-271a356f6265 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:27.154518 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-29f85b84-14db-4643-8efe-271a356f6265 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:27.155467 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-29f85b84-14db-4643-8efe-271a356f6265 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:27.156114 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-29f85b84-14db-4643-8efe-271a356f6265 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:27.156750 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-29f85b84-14db-4643-8efe-271a356f6265 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:27.458009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-29f85b84-14db-4643-8efe-271a356f6265 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:27.465966 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-29f85b84-14db-4643-8efe-271a356f6265 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05" status: 200 len: 1266 microversion: 2.1 time: 0.337822 Aug 05 20:13:27.476704 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 533/1045] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:27 2022] GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05 => generated 1266 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:28.486666 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-73fd9e4a-e98d-453d-aec0-00b2e35249db tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:28.487288 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-73fd9e4a-e98d-453d-aec0-00b2e35249db tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: d7407cff-913f-4141-9f0a-619b0e5b0b05] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:28.493735 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-73fd9e4a-e98d-453d-aec0-00b2e35249db tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:28.494229 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-73fd9e4a-e98d-453d-aec0-00b2e35249db tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:28.494669 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-73fd9e4a-e98d-453d-aec0-00b2e35249db tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:28.495376 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-73fd9e4a-e98d-453d-aec0-00b2e35249db tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:28.495837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-73fd9e4a-e98d-453d-aec0-00b2e35249db tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:28.496269 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-73fd9e4a-e98d-453d-aec0-00b2e35249db tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:28.636379 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-73fd9e4a-e98d-453d-aec0-00b2e35249db tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:28.649678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-73fd9e4a-e98d-453d-aec0-00b2e35249db tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05" status: 200 len: 1452 microversion: 2.1 time: 0.166875 Aug 05 20:13:28.665821 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 513/1046] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:28 2022] GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05 => generated 1452 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:28.672521 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b5b175e4-16a9-45c1-b639-9c962626144c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:28.673320 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-b5b175e4-16a9-45c1-b639-9c962626144c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: d7407cff-913f-4141-9f0a-619b0e5b0b05] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:28.679540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5b175e4-16a9-45c1-b639-9c962626144c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:28.680046 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5b175e4-16a9-45c1-b639-9c962626144c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:28.680464 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5b175e4-16a9-45c1-b639-9c962626144c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:28.681262 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5b175e4-16a9-45c1-b639-9c962626144c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:28.681721 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5b175e4-16a9-45c1-b639-9c962626144c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:28.682165 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5b175e4-16a9-45c1-b639-9c962626144c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:28.826366 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-b5b175e4-16a9-45c1-b639-9c962626144c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:28.834271 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b5b175e4-16a9-45c1-b639-9c962626144c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05" status: 200 len: 1452 microversion: 2.1 time: 0.166095 Aug 05 20:13:28.834838 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 534/1047] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:13:28 2022] GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:13:30.602666 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-dbce28c1-1013-46cf-84c5-2f5091ebb028 req-95d697bd-a50e-4fe1-9369-198c09229ade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7407cff-913f-4141-9f0a-619b0e5b0b05", "tag": "e2770287-7121-4b5f-adab-ca922bed34c8"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:30.614367 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-dbce28c1-1013-46cf-84c5-2f5091ebb028 req-95d697bd-a50e-4fe1-9369-198c09229ade service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:30.614862 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-dbce28c1-1013-46cf-84c5-2f5091ebb028 req-95d697bd-a50e-4fe1-9369-198c09229ade service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:30.615359 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-dbce28c1-1013-46cf-84c5-2f5091ebb028 req-95d697bd-a50e-4fe1-9369-198c09229ade service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:30.627836 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-dbce28c1-1013-46cf-84c5-2f5091ebb028 req-95d697bd-a50e-4fe1-9369-198c09229ade service nova] Creating event network-changed:e2770287-7121-4b5f-adab-ca922bed34c8 for instance d7407cff-913f-4141-9f0a-619b0e5b0b05 on hv-cinder-85221 Aug 05 20:13:30.636059 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-dbce28c1-1013-46cf-84c5-2f5091ebb028 req-95d697bd-a50e-4fe1-9369-198c09229ade service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037167 Aug 05 20:13:30.636731 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 514/1048] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:13:32.159602 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-2b4f1a25-2d79-4cef-818d-4e1ef0d02e38 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:32.160212 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-2b4f1a25-2d79-4cef-818d-4e1ef0d02e38 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:32.167420 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2b4f1a25-2d79-4cef-818d-4e1ef0d02e38 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:32.167921 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2b4f1a25-2d79-4cef-818d-4e1ef0d02e38 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:32.168355 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2b4f1a25-2d79-4cef-818d-4e1ef0d02e38 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:32.169113 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2b4f1a25-2d79-4cef-818d-4e1ef0d02e38 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:32.169565 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2b4f1a25-2d79-4cef-818d-4e1ef0d02e38 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:32.169991 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2b4f1a25-2d79-4cef-818d-4e1ef0d02e38 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:32.196198 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-2b4f1a25-2d79-4cef-818d-4e1ef0d02e38 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb/ips" status: 200 len: 151 microversion: 2.20 time: 0.040642 Aug 05 20:13:32.196842 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 535/1049] 10.222.0.39 () {60 vars in 1289 bytes} [Fri Aug 5 20:13:32 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:13:34.142869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-0767a1a0-e11c-4b77-bc81-6cbc18067faa tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:34.143503 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-0767a1a0-e11c-4b77-bc81-6cbc18067faa tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:34.149781 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0767a1a0-e11c-4b77-bc81-6cbc18067faa tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:34.150270 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0767a1a0-e11c-4b77-bc81-6cbc18067faa tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:34.150710 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0767a1a0-e11c-4b77-bc81-6cbc18067faa tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:34.151412 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0767a1a0-e11c-4b77-bc81-6cbc18067faa tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:34.151873 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0767a1a0-e11c-4b77-bc81-6cbc18067faa tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:34.152306 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0767a1a0-e11c-4b77-bc81-6cbc18067faa tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:34.169329 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=100 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:34.179722 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.objects.instance [None req-0767a1a0-e11c-4b77-bc81-6cbc18067faa tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lazy-loading 'flavor' on Instance uuid e4869087-6b2c-466b-beb3-36ad64c5d5eb {{(pid=118191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:13:34.357536 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-0767a1a0-e11c-4b77-bc81-6cbc18067faa tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "POST /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb/action" status: 202 len: 0 microversion: 2.20 time: 0.220280 Aug 05 20:13:34.358127 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 515/1050] 10.222.0.39 () {62 vars in 1319 bytes} [Fri Aug 5 20:13:34 2022] POST /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:13:34.367282 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-8e126b16-16d1-4ba0-a6a6-57f5e4e6f7c0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:34.367886 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-8e126b16-16d1-4ba0-a6a6-57f5e4e6f7c0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:34.374218 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8e126b16-16d1-4ba0-a6a6-57f5e4e6f7c0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:34.374790 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8e126b16-16d1-4ba0-a6a6-57f5e4e6f7c0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:34.375308 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8e126b16-16d1-4ba0-a6a6-57f5e4e6f7c0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:34.376193 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8e126b16-16d1-4ba0-a6a6-57f5e4e6f7c0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:34.376716 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8e126b16-16d1-4ba0-a6a6-57f5e4e6f7c0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:34.377216 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8e126b16-16d1-4ba0-a6a6-57f5e4e6f7c0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:34.510272 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-8e126b16-16d1-4ba0-a6a6-57f5e4e6f7c0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:34.520943 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-8e126b16-16d1-4ba0-a6a6-57f5e4e6f7c0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:34.522962 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-8e126b16-16d1-4ba0-a6a6-57f5e4e6f7c0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:34.524543 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-8e126b16-16d1-4ba0-a6a6-57f5e4e6f7c0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1724 microversion: 2.20 time: 0.161613 Aug 05 20:13:34.525113 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 536/1051] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:13:34 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:13:35.550791 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-8b8ad5d8-a4e4-4638-ad8e-23be361a1e32 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:35.551386 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-8b8ad5d8-a4e4-4638-ad8e-23be361a1e32 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:35.560559 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8b8ad5d8-a4e4-4638-ad8e-23be361a1e32 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:35.561064 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8b8ad5d8-a4e4-4638-ad8e-23be361a1e32 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:35.561494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8b8ad5d8-a4e4-4638-ad8e-23be361a1e32 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:35.562184 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8b8ad5d8-a4e4-4638-ad8e-23be361a1e32 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:35.562633 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8b8ad5d8-a4e4-4638-ad8e-23be361a1e32 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:35.563054 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8b8ad5d8-a4e4-4638-ad8e-23be361a1e32 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:35.694040 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8b8ad5d8-a4e4-4638-ad8e-23be361a1e32 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:35.701895 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8b8ad5d8-a4e4-4638-ad8e-23be361a1e32 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:35.703384 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8b8ad5d8-a4e4-4638-ad8e-23be361a1e32 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:35.705863 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-8b8ad5d8-a4e4-4638-ad8e-23be361a1e32 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1724 microversion: 2.20 time: 0.160645 Aug 05 20:13:35.706419 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 516/1052] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:13:35 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:13:36.729360 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-06c8e75d-accb-4721-827f-a6dfe76b1743 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:36.729973 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-06c8e75d-accb-4721-827f-a6dfe76b1743 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:36.737082 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-06c8e75d-accb-4721-827f-a6dfe76b1743 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:36.737697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-06c8e75d-accb-4721-827f-a6dfe76b1743 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:36.738012 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-06c8e75d-accb-4721-827f-a6dfe76b1743 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:36.738723 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-06c8e75d-accb-4721-827f-a6dfe76b1743 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:36.739185 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-06c8e75d-accb-4721-827f-a6dfe76b1743 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:36.739795 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-06c8e75d-accb-4721-827f-a6dfe76b1743 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:36.878114 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-06c8e75d-accb-4721-827f-a6dfe76b1743 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:36.886001 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-06c8e75d-accb-4721-827f-a6dfe76b1743 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:36.887513 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-06c8e75d-accb-4721-827f-a6dfe76b1743 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:36.888710 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-06c8e75d-accb-4721-827f-a6dfe76b1743 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1724 microversion: 2.20 time: 0.163274 Aug 05 20:13:36.889259 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 537/1053] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:13:36 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:13:37.913047 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-382cf7e9-5554-4da2-bf77-c7635114e79d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:37.913658 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-382cf7e9-5554-4da2-bf77-c7635114e79d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:37.920300 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-382cf7e9-5554-4da2-bf77-c7635114e79d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:37.920807 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-382cf7e9-5554-4da2-bf77-c7635114e79d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:37.921248 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-382cf7e9-5554-4da2-bf77-c7635114e79d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:37.921933 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-382cf7e9-5554-4da2-bf77-c7635114e79d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:37.922382 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-382cf7e9-5554-4da2-bf77-c7635114e79d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:37.922834 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-382cf7e9-5554-4da2-bf77-c7635114e79d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:38.052473 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-382cf7e9-5554-4da2-bf77-c7635114e79d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:38.060352 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-382cf7e9-5554-4da2-bf77-c7635114e79d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:38.061875 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-382cf7e9-5554-4da2-bf77-c7635114e79d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:38.063021 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-382cf7e9-5554-4da2-bf77-c7635114e79d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1724 microversion: 2.20 time: 0.153928 Aug 05 20:13:38.063752 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 517/1054] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:13:37 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:13:39.086352 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-560daf64-e8b1-4cf9-b408-eb1d9ace0899 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:39.086968 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-560daf64-e8b1-4cf9-b408-eb1d9ace0899 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:39.093380 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-560daf64-e8b1-4cf9-b408-eb1d9ace0899 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:39.093878 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-560daf64-e8b1-4cf9-b408-eb1d9ace0899 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:39.094320 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-560daf64-e8b1-4cf9-b408-eb1d9ace0899 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:39.095746 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-560daf64-e8b1-4cf9-b408-eb1d9ace0899 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:39.096608 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-560daf64-e8b1-4cf9-b408-eb1d9ace0899 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:39.097217 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-560daf64-e8b1-4cf9-b408-eb1d9ace0899 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:39.115749 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:39.232113 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-560daf64-e8b1-4cf9-b408-eb1d9ace0899 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:39.240149 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-560daf64-e8b1-4cf9-b408-eb1d9ace0899 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:39.241711 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-560daf64-e8b1-4cf9-b408-eb1d9ace0899 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:39.242862 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-560daf64-e8b1-4cf9-b408-eb1d9ace0899 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1724 microversion: 2.20 time: 0.160567 Aug 05 20:13:39.243413 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 538/1055] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:13:39 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:13:40.268415 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e819c9ca-855b-49ce-b476-865c6a6aec98 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:40.269055 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e819c9ca-855b-49ce-b476-865c6a6aec98 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:40.275815 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e819c9ca-855b-49ce-b476-865c6a6aec98 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:40.276313 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e819c9ca-855b-49ce-b476-865c6a6aec98 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:40.276803 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e819c9ca-855b-49ce-b476-865c6a6aec98 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:40.277511 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e819c9ca-855b-49ce-b476-865c6a6aec98 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:40.277999 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e819c9ca-855b-49ce-b476-865c6a6aec98 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:40.278463 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e819c9ca-855b-49ce-b476-865c6a6aec98 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:40.410868 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e819c9ca-855b-49ce-b476-865c6a6aec98 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:40.419057 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e819c9ca-855b-49ce-b476-865c6a6aec98 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:40.420610 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e819c9ca-855b-49ce-b476-865c6a6aec98 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:40.421763 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e819c9ca-855b-49ce-b476-865c6a6aec98 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1724 microversion: 2.20 time: 0.158638 Aug 05 20:13:40.422331 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 518/1056] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:13:40 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:13:41.446088 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-aceb9472-b85b-405d-b0f3-1ad230ff56d1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:41.446712 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-aceb9472-b85b-405d-b0f3-1ad230ff56d1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:41.453195 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-aceb9472-b85b-405d-b0f3-1ad230ff56d1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:41.453690 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-aceb9472-b85b-405d-b0f3-1ad230ff56d1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:41.454161 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-aceb9472-b85b-405d-b0f3-1ad230ff56d1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:41.455865 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-aceb9472-b85b-405d-b0f3-1ad230ff56d1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:41.456069 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-aceb9472-b85b-405d-b0f3-1ad230ff56d1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:41.456524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-aceb9472-b85b-405d-b0f3-1ad230ff56d1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:41.589630 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-aceb9472-b85b-405d-b0f3-1ad230ff56d1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:41.597588 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-aceb9472-b85b-405d-b0f3-1ad230ff56d1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:41.599119 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-aceb9472-b85b-405d-b0f3-1ad230ff56d1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:41.600286 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-aceb9472-b85b-405d-b0f3-1ad230ff56d1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1724 microversion: 2.20 time: 0.158428 Aug 05 20:13:41.600874 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 539/1057] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:13:41 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:13:42.624288 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3e5bd6e3-76b0-4c85-a777-89b39e4cebd1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:42.625069 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-3e5bd6e3-76b0-4c85-a777-89b39e4cebd1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:42.632182 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e5bd6e3-76b0-4c85-a777-89b39e4cebd1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:42.632701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e5bd6e3-76b0-4c85-a777-89b39e4cebd1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:42.633132 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e5bd6e3-76b0-4c85-a777-89b39e4cebd1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:42.633820 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e5bd6e3-76b0-4c85-a777-89b39e4cebd1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:42.634268 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e5bd6e3-76b0-4c85-a777-89b39e4cebd1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:42.634690 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e5bd6e3-76b0-4c85-a777-89b39e4cebd1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:42.764147 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3e5bd6e3-76b0-4c85-a777-89b39e4cebd1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:42.772311 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3e5bd6e3-76b0-4c85-a777-89b39e4cebd1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:42.773862 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3e5bd6e3-76b0-4c85-a777-89b39e4cebd1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:42.775028 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3e5bd6e3-76b0-4c85-a777-89b39e4cebd1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1724 microversion: 2.20 time: 0.154646 Aug 05 20:13:42.775587 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 519/1058] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:13:42 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:13:43.798171 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-fc2b2c58-47ad-4e3a-9b36-b4c8cd55dc63 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:43.799512 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-fc2b2c58-47ad-4e3a-9b36-b4c8cd55dc63 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:43.805985 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fc2b2c58-47ad-4e3a-9b36-b4c8cd55dc63 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:43.806473 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fc2b2c58-47ad-4e3a-9b36-b4c8cd55dc63 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:43.806914 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fc2b2c58-47ad-4e3a-9b36-b4c8cd55dc63 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:43.807613 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fc2b2c58-47ad-4e3a-9b36-b4c8cd55dc63 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:43.808074 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fc2b2c58-47ad-4e3a-9b36-b4c8cd55dc63 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:43.808503 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fc2b2c58-47ad-4e3a-9b36-b4c8cd55dc63 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:43.935925 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-fc2b2c58-47ad-4e3a-9b36-b4c8cd55dc63 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:43.944000 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-fc2b2c58-47ad-4e3a-9b36-b4c8cd55dc63 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:43.945607 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-fc2b2c58-47ad-4e3a-9b36-b4c8cd55dc63 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:43.946767 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-fc2b2c58-47ad-4e3a-9b36-b4c8cd55dc63 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1724 microversion: 2.20 time: 0.152648 Aug 05 20:13:43.947310 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 540/1059] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:13:43 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:13:44.971642 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-16df22ce-0e98-4dc5-a9dd-7f4f4411a24e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:44.972279 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-16df22ce-0e98-4dc5-a9dd-7f4f4411a24e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:44.978409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-16df22ce-0e98-4dc5-a9dd-7f4f4411a24e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:44.978894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-16df22ce-0e98-4dc5-a9dd-7f4f4411a24e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:44.979331 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-16df22ce-0e98-4dc5-a9dd-7f4f4411a24e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:44.980019 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-16df22ce-0e98-4dc5-a9dd-7f4f4411a24e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:44.980474 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-16df22ce-0e98-4dc5-a9dd-7f4f4411a24e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:44.980932 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-16df22ce-0e98-4dc5-a9dd-7f4f4411a24e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:45.112881 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-16df22ce-0e98-4dc5-a9dd-7f4f4411a24e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:45.120903 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-16df22ce-0e98-4dc5-a9dd-7f4f4411a24e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:45.122398 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-16df22ce-0e98-4dc5-a9dd-7f4f4411a24e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:45.123567 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-16df22ce-0e98-4dc5-a9dd-7f4f4411a24e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1724 microversion: 2.20 time: 0.157035 Aug 05 20:13:45.124125 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 520/1060] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:13:44 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:13:46.147577 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-7adc0742-9d0e-49e0-a44e-a9a2c1646ca4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:46.148185 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-7adc0742-9d0e-49e0-a44e-a9a2c1646ca4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:46.154762 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7adc0742-9d0e-49e0-a44e-a9a2c1646ca4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:46.155244 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7adc0742-9d0e-49e0-a44e-a9a2c1646ca4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:46.155677 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7adc0742-9d0e-49e0-a44e-a9a2c1646ca4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:46.156364 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7adc0742-9d0e-49e0-a44e-a9a2c1646ca4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:46.156846 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7adc0742-9d0e-49e0-a44e-a9a2c1646ca4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:46.157270 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7adc0742-9d0e-49e0-a44e-a9a2c1646ca4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:46.289121 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-7adc0742-9d0e-49e0-a44e-a9a2c1646ca4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:46.297345 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-7adc0742-9d0e-49e0-a44e-a9a2c1646ca4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:46.299479 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-7adc0742-9d0e-49e0-a44e-a9a2c1646ca4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:46.300660 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-7adc0742-9d0e-49e0-a44e-a9a2c1646ca4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1724 microversion: 2.20 time: 0.156929 Aug 05 20:13:46.301210 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 541/1061] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:13:46 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:13:47.324468 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-ee7025f6-736a-4432-b11d-465e84f282ae tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:47.325120 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-ee7025f6-736a-4432-b11d-465e84f282ae tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:47.332655 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ee7025f6-736a-4432-b11d-465e84f282ae tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:47.333147 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ee7025f6-736a-4432-b11d-465e84f282ae tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:47.333586 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ee7025f6-736a-4432-b11d-465e84f282ae tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:47.334282 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ee7025f6-736a-4432-b11d-465e84f282ae tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:47.334736 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ee7025f6-736a-4432-b11d-465e84f282ae tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:47.335165 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ee7025f6-736a-4432-b11d-465e84f282ae tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:47.470915 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-ee7025f6-736a-4432-b11d-465e84f282ae tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:47.478874 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-ee7025f6-736a-4432-b11d-465e84f282ae tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:47.480385 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-ee7025f6-736a-4432-b11d-465e84f282ae tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:47.481586 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-ee7025f6-736a-4432-b11d-465e84f282ae tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1724 microversion: 2.20 time: 0.161007 Aug 05 20:13:47.482143 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 521/1062] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:13:47 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:13:48.505208 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-6e3b4167-ecd1-461e-87dd-ff28d32f6f1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:48.505796 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-6e3b4167-ecd1-461e-87dd-ff28d32f6f1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:48.508133 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:48.516826 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6e3b4167-ecd1-461e-87dd-ff28d32f6f1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:48.518011 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6e3b4167-ecd1-461e-87dd-ff28d32f6f1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:48.518896 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6e3b4167-ecd1-461e-87dd-ff28d32f6f1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:48.519605 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6e3b4167-ecd1-461e-87dd-ff28d32f6f1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:48.520063 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6e3b4167-ecd1-461e-87dd-ff28d32f6f1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:48.520494 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6e3b4167-ecd1-461e-87dd-ff28d32f6f1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:48.651889 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-6e3b4167-ecd1-461e-87dd-ff28d32f6f1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:48.659940 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-6e3b4167-ecd1-461e-87dd-ff28d32f6f1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:48.661477 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-6e3b4167-ecd1-461e-87dd-ff28d32f6f1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:48.662644 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-6e3b4167-ecd1-461e-87dd-ff28d32f6f1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1724 microversion: 2.20 time: 0.161466 Aug 05 20:13:48.663203 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 542/1063] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:13:48 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:13:49.685931 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-c6f005fa-792e-4b4b-a257-6b4bdd9ee635 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:49.686467 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-c6f005fa-792e-4b4b-a257-6b4bdd9ee635 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:49.688863 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=38 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:13:49.695020 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c6f005fa-792e-4b4b-a257-6b4bdd9ee635 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:49.695539 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c6f005fa-792e-4b4b-a257-6b4bdd9ee635 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:49.695957 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c6f005fa-792e-4b4b-a257-6b4bdd9ee635 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:49.696685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c6f005fa-792e-4b4b-a257-6b4bdd9ee635 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:49.697255 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c6f005fa-792e-4b4b-a257-6b4bdd9ee635 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:49.697695 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c6f005fa-792e-4b4b-a257-6b4bdd9ee635 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:49.828940 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-c6f005fa-792e-4b4b-a257-6b4bdd9ee635 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:49.837591 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-c6f005fa-792e-4b4b-a257-6b4bdd9ee635 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:49.839107 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-c6f005fa-792e-4b4b-a257-6b4bdd9ee635 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:49.840307 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-c6f005fa-792e-4b4b-a257-6b4bdd9ee635 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1724 microversion: 2.20 time: 0.158402 Aug 05 20:13:49.840902 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 522/1064] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:13:49 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:13:50.863312 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-8dd673cc-4f4f-44d0-ad42-e5cd18c48aac tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:50.863948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-8dd673cc-4f4f-44d0-ad42-e5cd18c48aac tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:50.871432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8dd673cc-4f4f-44d0-ad42-e5cd18c48aac tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:50.871923 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8dd673cc-4f4f-44d0-ad42-e5cd18c48aac tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:50.872365 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8dd673cc-4f4f-44d0-ad42-e5cd18c48aac tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:50.873094 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8dd673cc-4f4f-44d0-ad42-e5cd18c48aac tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:50.873545 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8dd673cc-4f4f-44d0-ad42-e5cd18c48aac tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:50.873975 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8dd673cc-4f4f-44d0-ad42-e5cd18c48aac tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:51.081006 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-8dd673cc-4f4f-44d0-ad42-e5cd18c48aac tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:51.089042 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-8dd673cc-4f4f-44d0-ad42-e5cd18c48aac tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:51.090741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-8dd673cc-4f4f-44d0-ad42-e5cd18c48aac tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:51.091898 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-8dd673cc-4f4f-44d0-ad42-e5cd18c48aac tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1724 microversion: 2.20 time: 0.232541 Aug 05 20:13:51.092451 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 543/1065] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:13:50 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:13:52.120554 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a975da4f-e584-4174-a0c3-83c6beea3506 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:52.121182 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-a975da4f-e584-4174-a0c3-83c6beea3506 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:52.128661 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a975da4f-e584-4174-a0c3-83c6beea3506 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:52.129147 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a975da4f-e584-4174-a0c3-83c6beea3506 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:52.129584 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a975da4f-e584-4174-a0c3-83c6beea3506 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:52.130271 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a975da4f-e584-4174-a0c3-83c6beea3506 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:52.130717 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a975da4f-e584-4174-a0c3-83c6beea3506 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:52.131137 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a975da4f-e584-4174-a0c3-83c6beea3506 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:52.262001 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a975da4f-e584-4174-a0c3-83c6beea3506 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:52.271106 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a975da4f-e584-4174-a0c3-83c6beea3506 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:52.272612 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a975da4f-e584-4174-a0c3-83c6beea3506 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:52.273769 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-a975da4f-e584-4174-a0c3-83c6beea3506 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1745 microversion: 2.20 time: 0.157203 Aug 05 20:13:52.274325 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 523/1066] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:13:52 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:13:53.297901 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-88b7db30-5a33-4b56-8379-d68a97a29ea5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:53.298555 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-88b7db30-5a33-4b56-8379-d68a97a29ea5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:53.304974 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-88b7db30-5a33-4b56-8379-d68a97a29ea5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:53.305493 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-88b7db30-5a33-4b56-8379-d68a97a29ea5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:53.305931 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-88b7db30-5a33-4b56-8379-d68a97a29ea5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:53.306625 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-88b7db30-5a33-4b56-8379-d68a97a29ea5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:53.307082 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-88b7db30-5a33-4b56-8379-d68a97a29ea5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:53.307510 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-88b7db30-5a33-4b56-8379-d68a97a29ea5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:53.442555 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-88b7db30-5a33-4b56-8379-d68a97a29ea5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:53.450712 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-88b7db30-5a33-4b56-8379-d68a97a29ea5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:53.452217 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-88b7db30-5a33-4b56-8379-d68a97a29ea5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:53.453398 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-88b7db30-5a33-4b56-8379-d68a97a29ea5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1745 microversion: 2.20 time: 0.159446 Aug 05 20:13:53.453955 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 544/1067] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:13:53 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:13:53.678424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-4ca5fe1b-7b87-4058-accf-2138cc5e5412 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:53.678977 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-4ca5fe1b-7b87-4058-accf-2138cc5e5412 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:53.685336 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4ca5fe1b-7b87-4058-accf-2138cc5e5412 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:53.685834 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4ca5fe1b-7b87-4058-accf-2138cc5e5412 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:53.686278 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4ca5fe1b-7b87-4058-accf-2138cc5e5412 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:53.686983 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4ca5fe1b-7b87-4058-accf-2138cc5e5412 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:53.687476 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4ca5fe1b-7b87-4058-accf-2138cc5e5412 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:53.687912 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4ca5fe1b-7b87-4058-accf-2138cc5e5412 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:53.711557 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-4ca5fe1b-7b87-4058-accf-2138cc5e5412 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0/ips" status: 200 len: 146 microversion: 2.1 time: 0.037247 Aug 05 20:13:53.712133 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 524/1068] 10.222.0.39 () {58 vars in 1248 bytes} [Fri Aug 5 20:13:53 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:13:54.477854 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4decb9c5-7fb8-4c00-944d-3f0d5db43896 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:54.478462 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-4decb9c5-7fb8-4c00-944d-3f0d5db43896 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:54.484529 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4decb9c5-7fb8-4c00-944d-3f0d5db43896 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:54.485039 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4decb9c5-7fb8-4c00-944d-3f0d5db43896 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:54.485477 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4decb9c5-7fb8-4c00-944d-3f0d5db43896 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:54.486319 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4decb9c5-7fb8-4c00-944d-3f0d5db43896 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:54.486635 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4decb9c5-7fb8-4c00-944d-3f0d5db43896 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:54.487056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4decb9c5-7fb8-4c00-944d-3f0d5db43896 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:54.612922 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-4decb9c5-7fb8-4c00-944d-3f0d5db43896 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:54.620861 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-4decb9c5-7fb8-4c00-944d-3f0d5db43896 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:54.622356 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-4decb9c5-7fb8-4c00-944d-3f0d5db43896 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:54.623505 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-4decb9c5-7fb8-4c00-944d-3f0d5db43896 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1745 microversion: 2.20 time: 0.149728 Aug 05 20:13:54.624053 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 545/1069] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:13:54 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:13:55.647951 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-11943564-0908-470e-8e56-4ad43009f39e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:55.648657 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-11943564-0908-470e-8e56-4ad43009f39e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:55.655162 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-11943564-0908-470e-8e56-4ad43009f39e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:55.655581 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-11943564-0908-470e-8e56-4ad43009f39e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:55.656017 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-11943564-0908-470e-8e56-4ad43009f39e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:55.656737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-11943564-0908-470e-8e56-4ad43009f39e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:55.657194 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-11943564-0908-470e-8e56-4ad43009f39e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:55.657619 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-11943564-0908-470e-8e56-4ad43009f39e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:55.802917 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-11943564-0908-470e-8e56-4ad43009f39e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:55.812900 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-11943564-0908-470e-8e56-4ad43009f39e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:55.814847 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-11943564-0908-470e-8e56-4ad43009f39e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:55.816179 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-11943564-0908-470e-8e56-4ad43009f39e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1745 microversion: 2.20 time: 0.172121 Aug 05 20:13:55.820614 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 525/1070] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:13:55 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:13:55.940390 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-b1856c22-c2d6-4def-a275-d04a3d242d76 req-286e3cc8-70e9-4439-9431-443491759d64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4869087-6b2c-466b-beb3-36ad64c5d5eb", "name": "network-vif-plugged", "status": "completed", "tag": "13a23b2f-953f-46e0-b2af-1d2023dbbe54"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:55.949891 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-b1856c22-c2d6-4def-a275-d04a3d242d76 req-286e3cc8-70e9-4439-9431-443491759d64 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:55.950375 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-b1856c22-c2d6-4def-a275-d04a3d242d76 req-286e3cc8-70e9-4439-9431-443491759d64 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:55.950810 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-b1856c22-c2d6-4def-a275-d04a3d242d76 req-286e3cc8-70e9-4439-9431-443491759d64 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:55.962540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-b1856c22-c2d6-4def-a275-d04a3d242d76 req-286e3cc8-70e9-4439-9431-443491759d64 service nova] Creating event network-vif-plugged:13a23b2f-953f-46e0-b2af-1d2023dbbe54 for instance e4869087-6b2c-466b-beb3-36ad64c5d5eb on hv-cinder-85221 Aug 05 20:13:55.967565 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-b1856c22-c2d6-4def-a275-d04a3d242d76 req-286e3cc8-70e9-4439-9431-443491759d64 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227988 Aug 05 20:13:55.968220 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 546/1071] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:13:56.839699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e8d0039e-4963-4658-a7bf-f11a6548ab75 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:56.840306 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e8d0039e-4963-4658-a7bf-f11a6548ab75 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:56.847437 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e8d0039e-4963-4658-a7bf-f11a6548ab75 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:56.847950 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e8d0039e-4963-4658-a7bf-f11a6548ab75 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:56.848381 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e8d0039e-4963-4658-a7bf-f11a6548ab75 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:56.849091 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e8d0039e-4963-4658-a7bf-f11a6548ab75 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:56.849544 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e8d0039e-4963-4658-a7bf-f11a6548ab75 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:56.849991 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e8d0039e-4963-4658-a7bf-f11a6548ab75 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:56.977021 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e8d0039e-4963-4658-a7bf-f11a6548ab75 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:56.984923 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e8d0039e-4963-4658-a7bf-f11a6548ab75 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:56.986943 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e8d0039e-4963-4658-a7bf-f11a6548ab75 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:56.988105 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e8d0039e-4963-4658-a7bf-f11a6548ab75 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1745 microversion: 2.20 time: 0.152393 Aug 05 20:13:56.988687 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 526/1072] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:13:56 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:13:57.187632 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-e731df13-3306-4287-87f0-f85adcc17d13 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b266d16-9170-438b-b7ae-4811856dfc14"}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:13:57.190624 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-e731df13-3306-4287-87f0-f85adcc17d13 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:57.196642 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e731df13-3306-4287-87f0-f85adcc17d13 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:57.197125 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e731df13-3306-4287-87f0-f85adcc17d13 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:57.197556 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e731df13-3306-4287-87f0-f85adcc17d13 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:57.198242 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e731df13-3306-4287-87f0-f85adcc17d13 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:57.198691 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e731df13-3306-4287-87f0-f85adcc17d13 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:57.199113 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e731df13-3306-4287-87f0-f85adcc17d13 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:57.476214 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-e731df13-3306-4287-87f0-f85adcc17d13 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "POST /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292931 Aug 05 20:13:57.477091 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 547/1073] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Aug 5 20:13:57 2022] POST /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:13:58.013607 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-abb79041-83a8-4a05-b478-9a03e7f00b5e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:58.014219 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-abb79041-83a8-4a05-b478-9a03e7f00b5e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:58.022488 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-abb79041-83a8-4a05-b478-9a03e7f00b5e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:58.022952 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-abb79041-83a8-4a05-b478-9a03e7f00b5e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:58.023380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-abb79041-83a8-4a05-b478-9a03e7f00b5e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:58.024071 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-abb79041-83a8-4a05-b478-9a03e7f00b5e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:58.024524 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-abb79041-83a8-4a05-b478-9a03e7f00b5e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:58.024972 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-abb79041-83a8-4a05-b478-9a03e7f00b5e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:58.176945 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-abb79041-83a8-4a05-b478-9a03e7f00b5e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:58.184857 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-abb79041-83a8-4a05-b478-9a03e7f00b5e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:58.186366 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-abb79041-83a8-4a05-b478-9a03e7f00b5e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:58.187532 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-abb79041-83a8-4a05-b478-9a03e7f00b5e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1740 microversion: 2.20 time: 0.177861 Aug 05 20:13:58.188093 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 527/1074] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:13:58 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:13:59.212504 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-fb2716b4-35b2-42ca-a8ba-aa9b1fd9d923 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:13:59.213238 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-fb2716b4-35b2-42ca-a8ba-aa9b1fd9d923 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:13:59.219948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fb2716b4-35b2-42ca-a8ba-aa9b1fd9d923 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:59.221766 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fb2716b4-35b2-42ca-a8ba-aa9b1fd9d923 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:59.222347 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fb2716b4-35b2-42ca-a8ba-aa9b1fd9d923 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:59.223064 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fb2716b4-35b2-42ca-a8ba-aa9b1fd9d923 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:13:59.223701 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fb2716b4-35b2-42ca-a8ba-aa9b1fd9d923 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:13:59.224128 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fb2716b4-35b2-42ca-a8ba-aa9b1fd9d923 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:13:59.626423 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-fb2716b4-35b2-42ca-a8ba-aa9b1fd9d923 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:59.634598 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-fb2716b4-35b2-42ca-a8ba-aa9b1fd9d923 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:59.636067 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-fb2716b4-35b2-42ca-a8ba-aa9b1fd9d923 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:13:59.637249 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-fb2716b4-35b2-42ca-a8ba-aa9b1fd9d923 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1740 microversion: 2.20 time: 0.429430 Aug 05 20:13:59.637955 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 548/1075] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:13:59 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1740 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:00.667486 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f0d8d69d-d188-42ae-b903-e3de44a61586 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:00.668109 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f0d8d69d-d188-42ae-b903-e3de44a61586 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:00.676685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f0d8d69d-d188-42ae-b903-e3de44a61586 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:00.677294 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f0d8d69d-d188-42ae-b903-e3de44a61586 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:00.677838 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f0d8d69d-d188-42ae-b903-e3de44a61586 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:00.679239 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f0d8d69d-d188-42ae-b903-e3de44a61586 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:00.679807 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f0d8d69d-d188-42ae-b903-e3de44a61586 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:00.680563 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f0d8d69d-d188-42ae-b903-e3de44a61586 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:00.850419 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f0d8d69d-d188-42ae-b903-e3de44a61586 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:00.858702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f0d8d69d-d188-42ae-b903-e3de44a61586 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:00.860027 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f0d8d69d-d188-42ae-b903-e3de44a61586 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:00.861282 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f0d8d69d-d188-42ae-b903-e3de44a61586 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1740 microversion: 2.20 time: 0.202342 Aug 05 20:14:00.861846 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 528/1076] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:00 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:01.885188 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-26b01646-e1b9-439c-aa86-892c45492664 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:01.885791 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-26b01646-e1b9-439c-aa86-892c45492664 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:01.893015 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-26b01646-e1b9-439c-aa86-892c45492664 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:01.896013 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-26b01646-e1b9-439c-aa86-892c45492664 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:01.896716 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-26b01646-e1b9-439c-aa86-892c45492664 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:01.898089 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-26b01646-e1b9-439c-aa86-892c45492664 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:01.898797 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-26b01646-e1b9-439c-aa86-892c45492664 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:01.899884 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-26b01646-e1b9-439c-aa86-892c45492664 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:02.058236 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-26b01646-e1b9-439c-aa86-892c45492664 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:02.066842 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-26b01646-e1b9-439c-aa86-892c45492664 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:02.068359 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-26b01646-e1b9-439c-aa86-892c45492664 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:02.069538 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-26b01646-e1b9-439c-aa86-892c45492664 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1740 microversion: 2.20 time: 0.189334 Aug 05 20:14:02.070095 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 549/1077] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:01 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:03.092202 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-c0a35327-6cb1-4531-8d87-b1fba0f61a96 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:03.093605 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-c0a35327-6cb1-4531-8d87-b1fba0f61a96 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:03.101184 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c0a35327-6cb1-4531-8d87-b1fba0f61a96 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:03.101992 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c0a35327-6cb1-4531-8d87-b1fba0f61a96 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:03.102662 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c0a35327-6cb1-4531-8d87-b1fba0f61a96 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:03.103613 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c0a35327-6cb1-4531-8d87-b1fba0f61a96 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:03.104313 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c0a35327-6cb1-4531-8d87-b1fba0f61a96 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:03.104977 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c0a35327-6cb1-4531-8d87-b1fba0f61a96 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:03.254196 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-c0a35327-6cb1-4531-8d87-b1fba0f61a96 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:03.265541 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-c0a35327-6cb1-4531-8d87-b1fba0f61a96 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:03.267375 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-c0a35327-6cb1-4531-8d87-b1fba0f61a96 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:03.269461 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-c0a35327-6cb1-4531-8d87-b1fba0f61a96 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1740 microversion: 2.20 time: 0.180442 Aug 05 20:14:03.270035 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 529/1078] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:03 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:04.293894 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-f56d1e92-ac68-4bf6-8f1a-c29dab8c007b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:04.294513 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-f56d1e92-ac68-4bf6-8f1a-c29dab8c007b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:04.301027 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f56d1e92-ac68-4bf6-8f1a-c29dab8c007b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:04.301512 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f56d1e92-ac68-4bf6-8f1a-c29dab8c007b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:04.301947 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f56d1e92-ac68-4bf6-8f1a-c29dab8c007b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:04.302671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f56d1e92-ac68-4bf6-8f1a-c29dab8c007b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:04.303120 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f56d1e92-ac68-4bf6-8f1a-c29dab8c007b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:04.303569 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f56d1e92-ac68-4bf6-8f1a-c29dab8c007b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:04.458817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-f56d1e92-ac68-4bf6-8f1a-c29dab8c007b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:04.468037 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-f56d1e92-ac68-4bf6-8f1a-c29dab8c007b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:04.469558 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-f56d1e92-ac68-4bf6-8f1a-c29dab8c007b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:04.472203 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-f56d1e92-ac68-4bf6-8f1a-c29dab8c007b tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1740 microversion: 2.20 time: 0.181398 Aug 05 20:14:04.473248 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 550/1079] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:04 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:05.083257 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-db2beb9b-ac77-4f98-a0ce-701d9ba4170f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:14:05.091757 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-db2beb9b-ac77-4f98-a0ce-701d9ba4170f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:05.092497 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-db2beb9b-ac77-4f98-a0ce-701d9ba4170f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:05.093228 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-db2beb9b-ac77-4f98-a0ce-701d9ba4170f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:05.096018 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:14:05.164476 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-db2beb9b-ac77-4f98-a0ce-701d9ba4170f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Going to try to stop instance {{(pid=118191) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 05 20:14:05.213319 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-db2beb9b-ac77-4f98-a0ce-701d9ba4170f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "POST /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0/action" status: 202 len: 0 microversion: 2.1 time: 0.134443 Aug 05 20:14:05.213845 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 530/1080] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Aug 5 20:14:05 2022] POST /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:14:05.223297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-1e4cf95c-9aa5-4136-aff5-c2f78619253d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:05.224205 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-1e4cf95c-9aa5-4136-aff5-c2f78619253d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:05.230579 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1e4cf95c-9aa5-4136-aff5-c2f78619253d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:05.231727 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1e4cf95c-9aa5-4136-aff5-c2f78619253d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:05.231727 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1e4cf95c-9aa5-4136-aff5-c2f78619253d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:05.232212 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1e4cf95c-9aa5-4136-aff5-c2f78619253d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:05.232956 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1e4cf95c-9aa5-4136-aff5-c2f78619253d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:05.233498 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-1e4cf95c-9aa5-4136-aff5-c2f78619253d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:05.394740 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-1e4cf95c-9aa5-4136-aff5-c2f78619253d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:05.403940 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-1e4cf95c-9aa5-4136-aff5-c2f78619253d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1723 microversion: 2.1 time: 0.185706 Aug 05 20:14:05.404524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 551/1081] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:05 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:05.500704 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-dafa3cd9-2f6b-462b-aeff-54b573fd35a1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:05.501917 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-dafa3cd9-2f6b-462b-aeff-54b573fd35a1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:05.509916 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dafa3cd9-2f6b-462b-aeff-54b573fd35a1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:05.510439 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dafa3cd9-2f6b-462b-aeff-54b573fd35a1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:05.510870 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dafa3cd9-2f6b-462b-aeff-54b573fd35a1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:05.511594 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dafa3cd9-2f6b-462b-aeff-54b573fd35a1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:05.512049 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dafa3cd9-2f6b-462b-aeff-54b573fd35a1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:05.512481 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dafa3cd9-2f6b-462b-aeff-54b573fd35a1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:05.677606 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-dafa3cd9-2f6b-462b-aeff-54b573fd35a1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:05.687830 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-dafa3cd9-2f6b-462b-aeff-54b573fd35a1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:05.689392 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-dafa3cd9-2f6b-462b-aeff-54b573fd35a1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:05.691441 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-dafa3cd9-2f6b-462b-aeff-54b573fd35a1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1740 microversion: 2.20 time: 0.196170 Aug 05 20:14:05.692180 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 531/1082] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:05 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:06.428053 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-95ccdb30-53e4-4a38-a15e-99688fb57bc7 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:06.428643 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-95ccdb30-53e4-4a38-a15e-99688fb57bc7 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:06.436187 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-95ccdb30-53e4-4a38-a15e-99688fb57bc7 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:06.436712 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-95ccdb30-53e4-4a38-a15e-99688fb57bc7 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:06.437157 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-95ccdb30-53e4-4a38-a15e-99688fb57bc7 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:06.437855 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-95ccdb30-53e4-4a38-a15e-99688fb57bc7 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:06.438502 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-95ccdb30-53e4-4a38-a15e-99688fb57bc7 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:06.439376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-95ccdb30-53e4-4a38-a15e-99688fb57bc7 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:06.592776 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-95ccdb30-53e4-4a38-a15e-99688fb57bc7 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:06.603868 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-95ccdb30-53e4-4a38-a15e-99688fb57bc7 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1723 microversion: 2.1 time: 0.180507 Aug 05 20:14:06.604445 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 552/1083] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:06 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:06.716435 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-78d8c8cc-56fe-49b7-8165-4eccbc057884 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:06.717703 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-78d8c8cc-56fe-49b7-8165-4eccbc057884 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:06.725934 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-78d8c8cc-56fe-49b7-8165-4eccbc057884 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:06.726432 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-78d8c8cc-56fe-49b7-8165-4eccbc057884 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:06.727083 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-78d8c8cc-56fe-49b7-8165-4eccbc057884 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:06.727914 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-78d8c8cc-56fe-49b7-8165-4eccbc057884 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:06.728384 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-78d8c8cc-56fe-49b7-8165-4eccbc057884 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:06.729067 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-78d8c8cc-56fe-49b7-8165-4eccbc057884 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:06.879328 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-78d8c8cc-56fe-49b7-8165-4eccbc057884 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:06.887860 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-78d8c8cc-56fe-49b7-8165-4eccbc057884 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:06.889420 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-78d8c8cc-56fe-49b7-8165-4eccbc057884 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:06.890593 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-78d8c8cc-56fe-49b7-8165-4eccbc057884 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1740 microversion: 2.20 time: 0.178277 Aug 05 20:14:06.891427 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 532/1084] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:06 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:07.628799 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a6a22835-a96e-4af4-b16a-f8213d358ad6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:07.630253 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a6a22835-a96e-4af4-b16a-f8213d358ad6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:07.636950 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a6a22835-a96e-4af4-b16a-f8213d358ad6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:07.637862 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a6a22835-a96e-4af4-b16a-f8213d358ad6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:07.638361 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a6a22835-a96e-4af4-b16a-f8213d358ad6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:07.639129 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a6a22835-a96e-4af4-b16a-f8213d358ad6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:07.639651 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a6a22835-a96e-4af4-b16a-f8213d358ad6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:07.640261 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a6a22835-a96e-4af4-b16a-f8213d358ad6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:07.805334 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a6a22835-a96e-4af4-b16a-f8213d358ad6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:07.813573 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a6a22835-a96e-4af4-b16a-f8213d358ad6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1723 microversion: 2.1 time: 0.192375 Aug 05 20:14:07.830254 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 553/1085] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:07 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:07.916199 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-bf1a30d5-799c-4918-8601-d3822e0e1b61 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:07.917130 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-bf1a30d5-799c-4918-8601-d3822e0e1b61 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:07.923314 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bf1a30d5-799c-4918-8601-d3822e0e1b61 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:07.923843 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bf1a30d5-799c-4918-8601-d3822e0e1b61 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:07.924280 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bf1a30d5-799c-4918-8601-d3822e0e1b61 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:07.925279 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bf1a30d5-799c-4918-8601-d3822e0e1b61 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:07.925697 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bf1a30d5-799c-4918-8601-d3822e0e1b61 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:07.926123 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-bf1a30d5-799c-4918-8601-d3822e0e1b61 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:08.077783 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-bf1a30d5-799c-4918-8601-d3822e0e1b61 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:08.087363 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-bf1a30d5-799c-4918-8601-d3822e0e1b61 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:08.088930 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-bf1a30d5-799c-4918-8601-d3822e0e1b61 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:08.090162 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-bf1a30d5-799c-4918-8601-d3822e0e1b61 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1740 microversion: 2.20 time: 0.177906 Aug 05 20:14:08.090748 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 533/1086] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:07 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:08.842189 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-772b097d-7a76-4fad-85d7-cd07f27b041e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:08.843614 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-772b097d-7a76-4fad-85d7-cd07f27b041e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:08.851338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-772b097d-7a76-4fad-85d7-cd07f27b041e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:08.851833 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-772b097d-7a76-4fad-85d7-cd07f27b041e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:08.852264 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-772b097d-7a76-4fad-85d7-cd07f27b041e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:08.853077 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-772b097d-7a76-4fad-85d7-cd07f27b041e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:08.853529 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-772b097d-7a76-4fad-85d7-cd07f27b041e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:08.854114 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-772b097d-7a76-4fad-85d7-cd07f27b041e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:08.874679 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:14:08.996743 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-772b097d-7a76-4fad-85d7-cd07f27b041e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:09.006541 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-772b097d-7a76-4fad-85d7-cd07f27b041e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1723 microversion: 2.1 time: 0.168422 Aug 05 20:14:09.007589 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 554/1087] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:08 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:09.114657 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-445d301d-06d3-4c93-a81c-c9482d3ad1c0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:09.115324 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-445d301d-06d3-4c93-a81c-c9482d3ad1c0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:09.122288 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-445d301d-06d3-4c93-a81c-c9482d3ad1c0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:09.122772 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-445d301d-06d3-4c93-a81c-c9482d3ad1c0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:09.123325 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-445d301d-06d3-4c93-a81c-c9482d3ad1c0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:09.124023 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-445d301d-06d3-4c93-a81c-c9482d3ad1c0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:09.124476 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-445d301d-06d3-4c93-a81c-c9482d3ad1c0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:09.124930 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-445d301d-06d3-4c93-a81c-c9482d3ad1c0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:09.264312 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-445d301d-06d3-4c93-a81c-c9482d3ad1c0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:09.272659 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-445d301d-06d3-4c93-a81c-c9482d3ad1c0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:09.274153 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-445d301d-06d3-4c93-a81c-c9482d3ad1c0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:09.275296 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-445d301d-06d3-4c93-a81c-c9482d3ad1c0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1740 microversion: 2.20 time: 0.164633 Aug 05 20:14:09.275856 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 534/1088] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:09 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:10.029042 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b85ccc80-717e-4345-8af6-905a4656d839 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:10.029656 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-b85ccc80-717e-4345-8af6-905a4656d839 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:10.036701 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b85ccc80-717e-4345-8af6-905a4656d839 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:10.037191 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b85ccc80-717e-4345-8af6-905a4656d839 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:10.037631 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b85ccc80-717e-4345-8af6-905a4656d839 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:10.038325 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b85ccc80-717e-4345-8af6-905a4656d839 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:10.038782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b85ccc80-717e-4345-8af6-905a4656d839 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:10.039214 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b85ccc80-717e-4345-8af6-905a4656d839 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:10.255672 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-b85ccc80-717e-4345-8af6-905a4656d839 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:10.263603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b85ccc80-717e-4345-8af6-905a4656d839 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1723 microversion: 2.1 time: 0.238409 Aug 05 20:14:10.264183 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 555/1089] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:10 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:10.298797 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a1d7266e-3e08-47d8-b915-61f6862f7cdc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:10.299592 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-a1d7266e-3e08-47d8-b915-61f6862f7cdc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:10.306205 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a1d7266e-3e08-47d8-b915-61f6862f7cdc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:10.306694 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a1d7266e-3e08-47d8-b915-61f6862f7cdc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:10.307123 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a1d7266e-3e08-47d8-b915-61f6862f7cdc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:10.307810 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a1d7266e-3e08-47d8-b915-61f6862f7cdc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:10.308252 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a1d7266e-3e08-47d8-b915-61f6862f7cdc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:10.308712 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a1d7266e-3e08-47d8-b915-61f6862f7cdc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:10.508953 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a1d7266e-3e08-47d8-b915-61f6862f7cdc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:10.517217 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a1d7266e-3e08-47d8-b915-61f6862f7cdc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:10.519026 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a1d7266e-3e08-47d8-b915-61f6862f7cdc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:10.520204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-a1d7266e-3e08-47d8-b915-61f6862f7cdc tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1722 microversion: 2.20 time: 0.225309 Aug 05 20:14:10.520810 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 535/1090] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:10 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:11.286017 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b5985d40-d368-4844-9457-e57c4f288d6c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:11.286532 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-b5985d40-d368-4844-9457-e57c4f288d6c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:11.292939 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5985d40-d368-4844-9457-e57c4f288d6c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:11.293468 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5985d40-d368-4844-9457-e57c4f288d6c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:11.293917 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5985d40-d368-4844-9457-e57c4f288d6c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:11.294608 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5985d40-d368-4844-9457-e57c4f288d6c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:11.295060 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5985d40-d368-4844-9457-e57c4f288d6c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:11.295480 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5985d40-d368-4844-9457-e57c4f288d6c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:11.434793 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-b5985d40-d368-4844-9457-e57c4f288d6c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:11.442794 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b5985d40-d368-4844-9457-e57c4f288d6c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1723 microversion: 2.1 time: 0.160913 Aug 05 20:14:11.443364 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 556/1091] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:11 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:14:11.543400 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f2d7c608-3bbf-4474-980d-0eacc777f6a7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:11.543917 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f2d7c608-3bbf-4474-980d-0eacc777f6a7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:11.551060 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f2d7c608-3bbf-4474-980d-0eacc777f6a7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:11.551539 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f2d7c608-3bbf-4474-980d-0eacc777f6a7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:11.551969 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f2d7c608-3bbf-4474-980d-0eacc777f6a7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:11.552696 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f2d7c608-3bbf-4474-980d-0eacc777f6a7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:11.553147 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f2d7c608-3bbf-4474-980d-0eacc777f6a7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:11.553566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f2d7c608-3bbf-4474-980d-0eacc777f6a7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:11.685304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f2d7c608-3bbf-4474-980d-0eacc777f6a7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:11.693421 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f2d7c608-3bbf-4474-980d-0eacc777f6a7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:11.694926 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f2d7c608-3bbf-4474-980d-0eacc777f6a7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:11.696082 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f2d7c608-3bbf-4474-980d-0eacc777f6a7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1722 microversion: 2.20 time: 0.156733 Aug 05 20:14:11.696668 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 536/1092] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:11 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:12.464048 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-adc8767e-99b7-462f-8616-4f3982f7d97f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:12.464713 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-adc8767e-99b7-462f-8616-4f3982f7d97f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:12.471071 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-adc8767e-99b7-462f-8616-4f3982f7d97f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:12.471868 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-adc8767e-99b7-462f-8616-4f3982f7d97f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:12.472327 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-adc8767e-99b7-462f-8616-4f3982f7d97f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:12.473039 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-adc8767e-99b7-462f-8616-4f3982f7d97f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:12.473489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-adc8767e-99b7-462f-8616-4f3982f7d97f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:12.474088 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-adc8767e-99b7-462f-8616-4f3982f7d97f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:12.614901 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-adc8767e-99b7-462f-8616-4f3982f7d97f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:12.623068 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-adc8767e-99b7-462f-8616-4f3982f7d97f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1723 microversion: 2.1 time: 0.163110 Aug 05 20:14:12.623639 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 557/1093] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:12 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:12.719408 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-8447d61f-9914-450a-b3e8-e70a4ddccbef tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:12.719951 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-8447d61f-9914-450a-b3e8-e70a4ddccbef tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:12.727338 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8447d61f-9914-450a-b3e8-e70a4ddccbef tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:12.727823 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8447d61f-9914-450a-b3e8-e70a4ddccbef tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:12.728255 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8447d61f-9914-450a-b3e8-e70a4ddccbef tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:12.728984 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8447d61f-9914-450a-b3e8-e70a4ddccbef tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:12.729436 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8447d61f-9914-450a-b3e8-e70a4ddccbef tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:12.729861 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8447d61f-9914-450a-b3e8-e70a4ddccbef tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:12.859963 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8447d61f-9914-450a-b3e8-e70a4ddccbef tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:12.869393 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8447d61f-9914-450a-b3e8-e70a4ddccbef tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:12.870915 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8447d61f-9914-450a-b3e8-e70a4ddccbef tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:12.872082 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-8447d61f-9914-450a-b3e8-e70a4ddccbef tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1725 microversion: 2.20 time: 0.156741 Aug 05 20:14:12.872668 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 537/1094] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:12 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:12.895110 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-072e25f5-54c7-4057-a505-f659d85c0288 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d806b07b-d9c1-4781-9d88-f57825f340eb"}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:14:12.897560 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-072e25f5-54c7-4057-a505-f659d85c0288 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:12.903381 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-072e25f5-54c7-4057-a505-f659d85c0288 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:12.903861 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-072e25f5-54c7-4057-a505-f659d85c0288 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:12.904295 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-072e25f5-54c7-4057-a505-f659d85c0288 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:12.905012 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-072e25f5-54c7-4057-a505-f659d85c0288 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:12.905466 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-072e25f5-54c7-4057-a505-f659d85c0288 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:12.905977 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-072e25f5-54c7-4057-a505-f659d85c0288 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:13.190298 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-072e25f5-54c7-4057-a505-f659d85c0288 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "POST /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.299324 Aug 05 20:14:13.191162 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 558/1095] 10.222.0.39 () {62 vars in 1364 bytes} [Fri Aug 5 20:14:12 2022] POST /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb/os-volume_attachments => generated 188 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:14:13.316313 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-34f15e3a-adde-4033-b05d-45091427cfc4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:13.316840 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-34f15e3a-adde-4033-b05d-45091427cfc4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:13.322731 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-34f15e3a-adde-4033-b05d-45091427cfc4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:13.323220 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-34f15e3a-adde-4033-b05d-45091427cfc4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:13.323658 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-34f15e3a-adde-4033-b05d-45091427cfc4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:13.324354 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-34f15e3a-adde-4033-b05d-45091427cfc4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:13.324841 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-34f15e3a-adde-4033-b05d-45091427cfc4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:13.325270 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-34f15e3a-adde-4033-b05d-45091427cfc4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:13.562713 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-34f15e3a-adde-4033-b05d-45091427cfc4 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb/os-volume_attachments/d806b07b-d9c1-4781-9d88-f57825f340eb" status: 202 len: 0 microversion: 2.20 time: 0.250467 Aug 05 20:14:13.563323 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 538/1096] 10.222.0.39 () {60 vars in 1457 bytes} [Fri Aug 5 20:14:13 2022] DELETE /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb/os-volume_attachments/d806b07b-d9c1-4781-9d88-f57825f340eb => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:14:13.623792 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a91fafa6-732b-4119-aa0b-75f1b62f2118 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:14:13.624769 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a91fafa6-732b-4119-aa0b-75f1b62f2118 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:13.631874 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a91fafa6-732b-4119-aa0b-75f1b62f2118 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:13.632359 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a91fafa6-732b-4119-aa0b-75f1b62f2118 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:13.632827 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a91fafa6-732b-4119-aa0b-75f1b62f2118 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:13.633543 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a91fafa6-732b-4119-aa0b-75f1b62f2118 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:13.633986 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a91fafa6-732b-4119-aa0b-75f1b62f2118 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:13.634408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a91fafa6-732b-4119-aa0b-75f1b62f2118 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:13.646219 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-337ad3e1-cb99-41d2-a86b-5a64cb06a4c9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:13.647148 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-337ad3e1-cb99-41d2-a86b-5a64cb06a4c9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:13.653547 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-337ad3e1-cb99-41d2-a86b-5a64cb06a4c9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:13.654125 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-337ad3e1-cb99-41d2-a86b-5a64cb06a4c9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:13.654680 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-337ad3e1-cb99-41d2-a86b-5a64cb06a4c9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:13.655568 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-337ad3e1-cb99-41d2-a86b-5a64cb06a4c9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:13.656132 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-337ad3e1-cb99-41d2-a86b-5a64cb06a4c9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:13.656930 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-337ad3e1-cb99-41d2-a86b-5a64cb06a4c9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:13.666833 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a91fafa6-732b-4119-aa0b-75f1b62f2118 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118192) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 20:14:13.742687 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a91fafa6-732b-4119-aa0b-75f1b62f2118 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "POST /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb/action" status: 202 len: 0 microversion: 2.20 time: 0.122755 Aug 05 20:14:13.744758 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 559/1097] 10.222.0.39 () {62 vars in 1319 bytes} [Fri Aug 5 20:14:13 2022] POST /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:14:13.751828 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-5b14dfba-b31e-469d-b8af-48a69d015257 req-a0f4135b-47fa-444d-8d3d-9fbde2b586c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4869087-6b2c-466b-beb3-36ad64c5d5eb", "name": "network-vif-unplugged", "status": "completed", "tag": "13a23b2f-953f-46e0-b2af-1d2023dbbe54"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:14:13.769409 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-5b14dfba-b31e-469d-b8af-48a69d015257 req-a0f4135b-47fa-444d-8d3d-9fbde2b586c9 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:13.770190 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-5b14dfba-b31e-469d-b8af-48a69d015257 req-a0f4135b-47fa-444d-8d3d-9fbde2b586c9 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:13.770629 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-5b14dfba-b31e-469d-b8af-48a69d015257 req-a0f4135b-47fa-444d-8d3d-9fbde2b586c9 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:13.787981 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.compute.server_external_events [req-5b14dfba-b31e-469d-b8af-48a69d015257 req-a0f4135b-47fa-444d-8d3d-9fbde2b586c9 service nova] Unable to find a host for instance e4869087-6b2c-466b-beb3-36ad64c5d5eb. Dropping event network-vif-unplugged {{(pid=118192) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 05 20:14:13.790488 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-5b14dfba-b31e-469d-b8af-48a69d015257 req-a0f4135b-47fa-444d-8d3d-9fbde2b586c9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.043325 Aug 05 20:14:13.791367 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 560/1098] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 05 20:14:13.799041 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-9c30c8cb-4311-4f71-bb58-a0b9a29503b8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:13.800447 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-9c30c8cb-4311-4f71-bb58-a0b9a29503b8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:13.810055 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9c30c8cb-4311-4f71-bb58-a0b9a29503b8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:13.810773 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9c30c8cb-4311-4f71-bb58-a0b9a29503b8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:13.811543 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9c30c8cb-4311-4f71-bb58-a0b9a29503b8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:13.812638 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9c30c8cb-4311-4f71-bb58-a0b9a29503b8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:13.813328 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9c30c8cb-4311-4f71-bb58-a0b9a29503b8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:13.813985 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9c30c8cb-4311-4f71-bb58-a0b9a29503b8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:13.817837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-337ad3e1-cb99-41d2-a86b-5a64cb06a4c9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:13.826461 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-337ad3e1-cb99-41d2-a86b-5a64cb06a4c9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1723 microversion: 2.1 time: 0.185226 Aug 05 20:14:13.828132 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 539/1099] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:13 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:14:13.987599 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-9c30c8cb-4311-4f71-bb58-a0b9a29503b8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:13.995804 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-9c30c8cb-4311-4f71-bb58-a0b9a29503b8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:13.997365 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-9c30c8cb-4311-4f71-bb58-a0b9a29503b8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:13.998537 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-9c30c8cb-4311-4f71-bb58-a0b9a29503b8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1673 microversion: 2.20 time: 0.205709 Aug 05 20:14:13.999096 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 561/1100] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:13 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1673 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:14.850206 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-cbf4b1fb-9390-408f-9d53-e5a4c29ac6ab tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:14.850827 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-cbf4b1fb-9390-408f-9d53-e5a4c29ac6ab tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:14.856929 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cbf4b1fb-9390-408f-9d53-e5a4c29ac6ab tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:14.857413 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cbf4b1fb-9390-408f-9d53-e5a4c29ac6ab tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:14.857850 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cbf4b1fb-9390-408f-9d53-e5a4c29ac6ab tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:14.858542 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cbf4b1fb-9390-408f-9d53-e5a4c29ac6ab tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:14.859000 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cbf4b1fb-9390-408f-9d53-e5a4c29ac6ab tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:14.859432 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cbf4b1fb-9390-408f-9d53-e5a4c29ac6ab tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:15.001260 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-cbf4b1fb-9390-408f-9d53-e5a4c29ac6ab tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:15.009686 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-cbf4b1fb-9390-408f-9d53-e5a4c29ac6ab tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1723 microversion: 2.1 time: 0.163500 Aug 05 20:14:15.010276 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 540/1101] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:14 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:15.022044 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-3bf97753-b773-4394-ad02-b5d6bcf6ade0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:15.022657 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-3bf97753-b773-4394-ad02-b5d6bcf6ade0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:15.029320 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3bf97753-b773-4394-ad02-b5d6bcf6ade0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:15.029799 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3bf97753-b773-4394-ad02-b5d6bcf6ade0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:15.030228 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3bf97753-b773-4394-ad02-b5d6bcf6ade0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:15.030916 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3bf97753-b773-4394-ad02-b5d6bcf6ade0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:15.031362 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3bf97753-b773-4394-ad02-b5d6bcf6ade0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:15.031781 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3bf97753-b773-4394-ad02-b5d6bcf6ade0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:15.249707 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-3bf97753-b773-4394-ad02-b5d6bcf6ade0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:15.257862 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-3bf97753-b773-4394-ad02-b5d6bcf6ade0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:15.259429 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-3bf97753-b773-4394-ad02-b5d6bcf6ade0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:15.260603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-3bf97753-b773-4394-ad02-b5d6bcf6ade0 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1731 microversion: 2.20 time: 0.242483 Aug 05 20:14:15.261291 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 562/1102] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:15 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1731 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:16.031183 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-d5b8b3e6-9155-4baf-a43c-90e223386a73 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:16.031726 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-d5b8b3e6-9155-4baf-a43c-90e223386a73 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:16.038681 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d5b8b3e6-9155-4baf-a43c-90e223386a73 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:16.039170 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d5b8b3e6-9155-4baf-a43c-90e223386a73 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:16.039604 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d5b8b3e6-9155-4baf-a43c-90e223386a73 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:16.040289 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d5b8b3e6-9155-4baf-a43c-90e223386a73 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:16.040770 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d5b8b3e6-9155-4baf-a43c-90e223386a73 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:16.041194 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d5b8b3e6-9155-4baf-a43c-90e223386a73 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:16.184732 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-d5b8b3e6-9155-4baf-a43c-90e223386a73 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:16.193637 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-d5b8b3e6-9155-4baf-a43c-90e223386a73 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1723 microversion: 2.1 time: 0.166298 Aug 05 20:14:16.194222 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 541/1103] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:16 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:16.286337 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-5625e9e1-10e8-419e-92ad-5db910f1e11d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:16.286962 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-5625e9e1-10e8-419e-92ad-5db910f1e11d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:16.306850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5625e9e1-10e8-419e-92ad-5db910f1e11d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:16.307636 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5625e9e1-10e8-419e-92ad-5db910f1e11d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:16.308247 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5625e9e1-10e8-419e-92ad-5db910f1e11d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:16.309158 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5625e9e1-10e8-419e-92ad-5db910f1e11d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:16.309773 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5625e9e1-10e8-419e-92ad-5db910f1e11d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:16.310361 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5625e9e1-10e8-419e-92ad-5db910f1e11d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:16.491393 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-5625e9e1-10e8-419e-92ad-5db910f1e11d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:16.501156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-5625e9e1-10e8-419e-92ad-5db910f1e11d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:16.504467 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-5625e9e1-10e8-419e-92ad-5db910f1e11d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:16.506671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-5625e9e1-10e8-419e-92ad-5db910f1e11d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1731 microversion: 2.20 time: 0.225579 Aug 05 20:14:16.518598 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 563/1104] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:16 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1731 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:17.215761 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9d00d98e-ce7e-44a7-938f-71e3542d60e1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:17.216443 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-9d00d98e-ce7e-44a7-938f-71e3542d60e1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:17.223825 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9d00d98e-ce7e-44a7-938f-71e3542d60e1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:17.224320 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9d00d98e-ce7e-44a7-938f-71e3542d60e1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:17.224800 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9d00d98e-ce7e-44a7-938f-71e3542d60e1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:17.225515 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9d00d98e-ce7e-44a7-938f-71e3542d60e1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:17.225975 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9d00d98e-ce7e-44a7-938f-71e3542d60e1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:17.226409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9d00d98e-ce7e-44a7-938f-71e3542d60e1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:17.365882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9d00d98e-ce7e-44a7-938f-71e3542d60e1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:17.374638 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-9d00d98e-ce7e-44a7-938f-71e3542d60e1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1723 microversion: 2.1 time: 0.162827 Aug 05 20:14:17.375419 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 542/1105] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:17 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:17.536742 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4d583669-c47a-4405-b96b-221c700ca826 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:17.537741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-4d583669-c47a-4405-b96b-221c700ca826 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:17.545106 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4d583669-c47a-4405-b96b-221c700ca826 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:17.545593 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4d583669-c47a-4405-b96b-221c700ca826 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:17.546030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4d583669-c47a-4405-b96b-221c700ca826 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:17.546730 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4d583669-c47a-4405-b96b-221c700ca826 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:17.547178 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4d583669-c47a-4405-b96b-221c700ca826 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:17.547603 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-4d583669-c47a-4405-b96b-221c700ca826 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:17.689541 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-4d583669-c47a-4405-b96b-221c700ca826 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:17.699360 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-4d583669-c47a-4405-b96b-221c700ca826 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:17.700933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-4d583669-c47a-4405-b96b-221c700ca826 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:17.702207 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-4d583669-c47a-4405-b96b-221c700ca826 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1731 microversion: 2.20 time: 0.172679 Aug 05 20:14:17.702969 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 564/1106] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:17 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:18.398121 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-c6318796-29ec-4692-9aa7-3333f12f1de1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:18.398728 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-c6318796-29ec-4692-9aa7-3333f12f1de1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:18.407899 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c6318796-29ec-4692-9aa7-3333f12f1de1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:18.408427 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c6318796-29ec-4692-9aa7-3333f12f1de1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:18.410964 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c6318796-29ec-4692-9aa7-3333f12f1de1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:18.410964 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c6318796-29ec-4692-9aa7-3333f12f1de1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:18.410964 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c6318796-29ec-4692-9aa7-3333f12f1de1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:18.411299 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c6318796-29ec-4692-9aa7-3333f12f1de1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:18.415732 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:14:18.560953 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-c6318796-29ec-4692-9aa7-3333f12f1de1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:18.569409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-c6318796-29ec-4692-9aa7-3333f12f1de1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1723 microversion: 2.1 time: 0.176091 Aug 05 20:14:18.570198 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 543/1107] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:18 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:18.725551 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-e61a11e0-13d8-480e-91a1-e5bc6fb2a22e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:18.726082 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-e61a11e0-13d8-480e-91a1-e5bc6fb2a22e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:18.728798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:14:18.735519 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e61a11e0-13d8-480e-91a1-e5bc6fb2a22e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:18.736013 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e61a11e0-13d8-480e-91a1-e5bc6fb2a22e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:18.736459 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e61a11e0-13d8-480e-91a1-e5bc6fb2a22e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:18.737208 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e61a11e0-13d8-480e-91a1-e5bc6fb2a22e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:18.737808 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e61a11e0-13d8-480e-91a1-e5bc6fb2a22e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:18.738421 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e61a11e0-13d8-480e-91a1-e5bc6fb2a22e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:18.882996 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-e61a11e0-13d8-480e-91a1-e5bc6fb2a22e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:18.892881 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-e61a11e0-13d8-480e-91a1-e5bc6fb2a22e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:18.895611 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-e61a11e0-13d8-480e-91a1-e5bc6fb2a22e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:18.897115 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-e61a11e0-13d8-480e-91a1-e5bc6fb2a22e tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1731 microversion: 2.20 time: 0.175562 Aug 05 20:14:18.898294 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 565/1108] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:18 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:19.591359 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9f81b7e4-abc9-49c0-a696-7d269b4853b9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:19.592018 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-9f81b7e4-abc9-49c0-a696-7d269b4853b9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:19.599212 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9f81b7e4-abc9-49c0-a696-7d269b4853b9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:19.599721 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9f81b7e4-abc9-49c0-a696-7d269b4853b9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:19.600167 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9f81b7e4-abc9-49c0-a696-7d269b4853b9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:19.600915 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9f81b7e4-abc9-49c0-a696-7d269b4853b9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:19.601374 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9f81b7e4-abc9-49c0-a696-7d269b4853b9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:19.601807 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9f81b7e4-abc9-49c0-a696-7d269b4853b9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:19.743796 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9f81b7e4-abc9-49c0-a696-7d269b4853b9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:19.751896 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-9f81b7e4-abc9-49c0-a696-7d269b4853b9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1723 microversion: 2.1 time: 0.164373 Aug 05 20:14:19.752790 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 544/1109] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:19 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:19.921402 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-565db394-9fa3-410d-af22-ef5313500df8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:19.922102 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-565db394-9fa3-410d-af22-ef5313500df8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:19.929247 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-565db394-9fa3-410d-af22-ef5313500df8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:19.929746 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-565db394-9fa3-410d-af22-ef5313500df8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:19.930187 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-565db394-9fa3-410d-af22-ef5313500df8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:19.930902 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-565db394-9fa3-410d-af22-ef5313500df8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:19.931361 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-565db394-9fa3-410d-af22-ef5313500df8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:19.931794 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-565db394-9fa3-410d-af22-ef5313500df8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:20.079120 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-565db394-9fa3-410d-af22-ef5313500df8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:20.089798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-565db394-9fa3-410d-af22-ef5313500df8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:20.091303 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-565db394-9fa3-410d-af22-ef5313500df8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:20.092464 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-565db394-9fa3-410d-af22-ef5313500df8 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1731 microversion: 2.20 time: 0.174996 Aug 05 20:14:20.093053 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 566/1110] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:19 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:20.774566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-516dacd2-4ee7-4fa3-b181-ba273c86ea1f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:20.775223 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-516dacd2-4ee7-4fa3-b181-ba273c86ea1f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:20.777847 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=46 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:14:20.784198 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-516dacd2-4ee7-4fa3-b181-ba273c86ea1f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:20.785413 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-516dacd2-4ee7-4fa3-b181-ba273c86ea1f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:20.788621 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-516dacd2-4ee7-4fa3-b181-ba273c86ea1f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:20.788621 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-516dacd2-4ee7-4fa3-b181-ba273c86ea1f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:20.788621 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-516dacd2-4ee7-4fa3-b181-ba273c86ea1f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:20.788621 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-516dacd2-4ee7-4fa3-b181-ba273c86ea1f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:20.932589 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-516dacd2-4ee7-4fa3-b181-ba273c86ea1f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:20.942713 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-516dacd2-4ee7-4fa3-b181-ba273c86ea1f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1723 microversion: 2.1 time: 0.171951 Aug 05 20:14:20.943396 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 545/1111] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:20 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:21.117883 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-e2e0a8ed-4206-410f-934b-a5398d601100 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:21.119200 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-e2e0a8ed-4206-410f-934b-a5398d601100 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:21.125859 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e2e0a8ed-4206-410f-934b-a5398d601100 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:21.126408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e2e0a8ed-4206-410f-934b-a5398d601100 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:21.126887 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e2e0a8ed-4206-410f-934b-a5398d601100 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:21.127588 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e2e0a8ed-4206-410f-934b-a5398d601100 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:21.128359 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e2e0a8ed-4206-410f-934b-a5398d601100 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:21.129378 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e2e0a8ed-4206-410f-934b-a5398d601100 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:21.274848 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-e2e0a8ed-4206-410f-934b-a5398d601100 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:21.285832 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-e2e0a8ed-4206-410f-934b-a5398d601100 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:21.289573 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-e2e0a8ed-4206-410f-934b-a5398d601100 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:21.296705 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-e2e0a8ed-4206-410f-934b-a5398d601100 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1731 microversion: 2.20 time: 0.179147 Aug 05 20:14:21.299738 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 567/1112] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:21 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:21.964256 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-2d46a3a3-348c-4257-8be2-d22a858a680d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:21.965526 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-2d46a3a3-348c-4257-8be2-d22a858a680d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:21.971458 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2d46a3a3-348c-4257-8be2-d22a858a680d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:21.971878 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2d46a3a3-348c-4257-8be2-d22a858a680d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:21.972886 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2d46a3a3-348c-4257-8be2-d22a858a680d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:21.973603 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2d46a3a3-348c-4257-8be2-d22a858a680d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:21.974083 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2d46a3a3-348c-4257-8be2-d22a858a680d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:21.974496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2d46a3a3-348c-4257-8be2-d22a858a680d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:22.125896 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-2d46a3a3-348c-4257-8be2-d22a858a680d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:22.134702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-2d46a3a3-348c-4257-8be2-d22a858a680d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1723 microversion: 2.1 time: 0.174505 Aug 05 20:14:22.135288 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 546/1113] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:21 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:14:22.326560 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-10ca2c12-2acd-4ff6-b8ac-78ce072342bf tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:22.327129 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-10ca2c12-2acd-4ff6-b8ac-78ce072342bf tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:22.334675 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-10ca2c12-2acd-4ff6-b8ac-78ce072342bf tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:22.335164 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-10ca2c12-2acd-4ff6-b8ac-78ce072342bf tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:22.335605 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-10ca2c12-2acd-4ff6-b8ac-78ce072342bf tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:22.336315 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-10ca2c12-2acd-4ff6-b8ac-78ce072342bf tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:22.336808 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-10ca2c12-2acd-4ff6-b8ac-78ce072342bf tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:22.337236 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-10ca2c12-2acd-4ff6-b8ac-78ce072342bf tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:22.342656 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:14:22.485166 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-10ca2c12-2acd-4ff6-b8ac-78ce072342bf tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:22.494431 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-10ca2c12-2acd-4ff6-b8ac-78ce072342bf tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:22.496008 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-10ca2c12-2acd-4ff6-b8ac-78ce072342bf tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:22.497233 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-10ca2c12-2acd-4ff6-b8ac-78ce072342bf tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1731 microversion: 2.20 time: 0.175219 Aug 05 20:14:22.498127 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 568/1114] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:22 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:23.156894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7f64fbe9-65a1-4a7d-9182-548525741c1d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:23.157526 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-7f64fbe9-65a1-4a7d-9182-548525741c1d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:23.165216 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7f64fbe9-65a1-4a7d-9182-548525741c1d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:23.165709 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7f64fbe9-65a1-4a7d-9182-548525741c1d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:23.166147 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7f64fbe9-65a1-4a7d-9182-548525741c1d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:23.166857 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7f64fbe9-65a1-4a7d-9182-548525741c1d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:23.167333 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7f64fbe9-65a1-4a7d-9182-548525741c1d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:23.167745 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7f64fbe9-65a1-4a7d-9182-548525741c1d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:23.312186 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-7f64fbe9-65a1-4a7d-9182-548525741c1d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:23.321818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-7f64fbe9-65a1-4a7d-9182-548525741c1d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1723 microversion: 2.1 time: 0.168671 Aug 05 20:14:23.322414 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 547/1115] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:23 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:23.522477 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-eaa099e5-97c9-4980-a009-4beccb9e3598 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:23.523143 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-eaa099e5-97c9-4980-a009-4beccb9e3598 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:23.529495 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eaa099e5-97c9-4980-a009-4beccb9e3598 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:23.529979 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eaa099e5-97c9-4980-a009-4beccb9e3598 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:23.530411 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eaa099e5-97c9-4980-a009-4beccb9e3598 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:23.531105 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eaa099e5-97c9-4980-a009-4beccb9e3598 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:23.531555 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eaa099e5-97c9-4980-a009-4beccb9e3598 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:23.531969 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-eaa099e5-97c9-4980-a009-4beccb9e3598 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:23.679585 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-eaa099e5-97c9-4980-a009-4beccb9e3598 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:23.687792 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-eaa099e5-97c9-4980-a009-4beccb9e3598 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:23.689392 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-eaa099e5-97c9-4980-a009-4beccb9e3598 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:23.690561 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-eaa099e5-97c9-4980-a009-4beccb9e3598 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1731 microversion: 2.20 time: 0.173148 Aug 05 20:14:23.691747 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 569/1116] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:23 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:24.344200 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-dc21c078-0e59-484a-bd9e-a2f650a5f29b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:24.344849 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-dc21c078-0e59-484a-bd9e-a2f650a5f29b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:24.352064 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dc21c078-0e59-484a-bd9e-a2f650a5f29b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:24.352552 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dc21c078-0e59-484a-bd9e-a2f650a5f29b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:24.353172 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dc21c078-0e59-484a-bd9e-a2f650a5f29b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:24.353936 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dc21c078-0e59-484a-bd9e-a2f650a5f29b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:24.354407 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dc21c078-0e59-484a-bd9e-a2f650a5f29b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:24.354830 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dc21c078-0e59-484a-bd9e-a2f650a5f29b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:24.498272 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-dc21c078-0e59-484a-bd9e-a2f650a5f29b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:24.507760 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-dc21c078-0e59-484a-bd9e-a2f650a5f29b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1723 microversion: 2.1 time: 0.167388 Aug 05 20:14:24.508425 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 548/1117] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:24 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:14:24.715593 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-2156fe7a-8965-40c8-986a-7ec3a8fcc2ff tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:24.716250 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-2156fe7a-8965-40c8-986a-7ec3a8fcc2ff tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:24.723812 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2156fe7a-8965-40c8-986a-7ec3a8fcc2ff tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:24.724502 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2156fe7a-8965-40c8-986a-7ec3a8fcc2ff tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:24.725032 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2156fe7a-8965-40c8-986a-7ec3a8fcc2ff tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:24.725737 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2156fe7a-8965-40c8-986a-7ec3a8fcc2ff tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:24.726190 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2156fe7a-8965-40c8-986a-7ec3a8fcc2ff tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:24.726611 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2156fe7a-8965-40c8-986a-7ec3a8fcc2ff tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:24.867458 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-2156fe7a-8965-40c8-986a-7ec3a8fcc2ff tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:24.875532 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-2156fe7a-8965-40c8-986a-7ec3a8fcc2ff tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:24.877083 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-2156fe7a-8965-40c8-986a-7ec3a8fcc2ff tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:24.878793 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-2156fe7a-8965-40c8-986a-7ec3a8fcc2ff tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1731 microversion: 2.20 time: 0.166761 Aug 05 20:14:24.879668 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 570/1118] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:24 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:25.529799 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9321092a-a72a-4e84-a05c-2cbbced44880 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:25.530391 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-9321092a-a72a-4e84-a05c-2cbbced44880 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:25.537611 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9321092a-a72a-4e84-a05c-2cbbced44880 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:25.538096 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9321092a-a72a-4e84-a05c-2cbbced44880 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:25.538710 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9321092a-a72a-4e84-a05c-2cbbced44880 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:25.540161 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9321092a-a72a-4e84-a05c-2cbbced44880 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:25.540875 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9321092a-a72a-4e84-a05c-2cbbced44880 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:25.541746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-9321092a-a72a-4e84-a05c-2cbbced44880 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:25.676773 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9321092a-a72a-4e84-a05c-2cbbced44880 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:25.684670 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-9321092a-a72a-4e84-a05c-2cbbced44880 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1723 microversion: 2.1 time: 0.158780 Aug 05 20:14:25.685229 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 549/1119] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:25 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:25.903010 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-2cafb9a1-fe45-46bb-ab72-b6adc2aeece2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:25.903624 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-2cafb9a1-fe45-46bb-ab72-b6adc2aeece2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:25.910713 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2cafb9a1-fe45-46bb-ab72-b6adc2aeece2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:25.911202 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2cafb9a1-fe45-46bb-ab72-b6adc2aeece2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:25.911643 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2cafb9a1-fe45-46bb-ab72-b6adc2aeece2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:25.912338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2cafb9a1-fe45-46bb-ab72-b6adc2aeece2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:25.912831 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2cafb9a1-fe45-46bb-ab72-b6adc2aeece2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:25.913258 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2cafb9a1-fe45-46bb-ab72-b6adc2aeece2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:26.042889 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-2cafb9a1-fe45-46bb-ab72-b6adc2aeece2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:26.050977 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-2cafb9a1-fe45-46bb-ab72-b6adc2aeece2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:26.052520 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-2cafb9a1-fe45-46bb-ab72-b6adc2aeece2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:26.053731 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-2cafb9a1-fe45-46bb-ab72-b6adc2aeece2 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1731 microversion: 2.20 time: 0.154673 Aug 05 20:14:26.054293 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 571/1120] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:25 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:26.705576 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-935fc24a-ae0f-4d86-83ea-2adc575c5476 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:26.706201 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-935fc24a-ae0f-4d86-83ea-2adc575c5476 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:26.713057 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-935fc24a-ae0f-4d86-83ea-2adc575c5476 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:26.713551 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-935fc24a-ae0f-4d86-83ea-2adc575c5476 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:26.713988 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-935fc24a-ae0f-4d86-83ea-2adc575c5476 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:26.714681 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-935fc24a-ae0f-4d86-83ea-2adc575c5476 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:26.715139 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-935fc24a-ae0f-4d86-83ea-2adc575c5476 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:26.715568 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-935fc24a-ae0f-4d86-83ea-2adc575c5476 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:26.849391 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-935fc24a-ae0f-4d86-83ea-2adc575c5476 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:26.857237 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-935fc24a-ae0f-4d86-83ea-2adc575c5476 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1723 microversion: 2.1 time: 0.155552 Aug 05 20:14:26.857805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 550/1121] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:26 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:27.076761 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-32daa9c5-6d3b-4f96-ac86-005f67dd27c5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:27.077314 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-32daa9c5-6d3b-4f96-ac86-005f67dd27c5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:27.083968 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-32daa9c5-6d3b-4f96-ac86-005f67dd27c5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:27.084460 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-32daa9c5-6d3b-4f96-ac86-005f67dd27c5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:27.084933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-32daa9c5-6d3b-4f96-ac86-005f67dd27c5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:27.085634 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-32daa9c5-6d3b-4f96-ac86-005f67dd27c5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:27.086095 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-32daa9c5-6d3b-4f96-ac86-005f67dd27c5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:27.086524 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-32daa9c5-6d3b-4f96-ac86-005f67dd27c5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:27.221876 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-32daa9c5-6d3b-4f96-ac86-005f67dd27c5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:27.229924 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-32daa9c5-6d3b-4f96-ac86-005f67dd27c5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:27.231425 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-32daa9c5-6d3b-4f96-ac86-005f67dd27c5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:27.232650 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-32daa9c5-6d3b-4f96-ac86-005f67dd27c5 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1731 microversion: 2.20 time: 0.159865 Aug 05 20:14:27.233209 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 572/1122] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:27 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:27.880053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e1b14044-5265-4723-9fb8-9096794ae5e1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:27.880697 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e1b14044-5265-4723-9fb8-9096794ae5e1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:27.887247 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e1b14044-5265-4723-9fb8-9096794ae5e1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:27.887758 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e1b14044-5265-4723-9fb8-9096794ae5e1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:27.888189 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e1b14044-5265-4723-9fb8-9096794ae5e1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:27.888922 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e1b14044-5265-4723-9fb8-9096794ae5e1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:27.889381 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e1b14044-5265-4723-9fb8-9096794ae5e1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:27.889814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e1b14044-5265-4723-9fb8-9096794ae5e1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:28.017403 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e1b14044-5265-4723-9fb8-9096794ae5e1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:28.025287 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e1b14044-5265-4723-9fb8-9096794ae5e1 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1723 microversion: 2.1 time: 0.149727 Aug 05 20:14:28.025857 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 551/1123] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:27 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:28.259071 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b5849693-73e9-4668-a4f1-6b3829487502 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:28.259684 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-b5849693-73e9-4668-a4f1-6b3829487502 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:28.266041 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5849693-73e9-4668-a4f1-6b3829487502 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:28.266531 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5849693-73e9-4668-a4f1-6b3829487502 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:28.267312 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5849693-73e9-4668-a4f1-6b3829487502 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:28.268012 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5849693-73e9-4668-a4f1-6b3829487502 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:28.268486 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5849693-73e9-4668-a4f1-6b3829487502 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:28.269507 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5849693-73e9-4668-a4f1-6b3829487502 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:28.403959 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-b5849693-73e9-4668-a4f1-6b3829487502 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:28.412793 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-b5849693-73e9-4668-a4f1-6b3829487502 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:28.414322 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-b5849693-73e9-4668-a4f1-6b3829487502 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:28.415502 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b5849693-73e9-4668-a4f1-6b3829487502 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1731 microversion: 2.20 time: 0.160374 Aug 05 20:14:28.420969 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 573/1124] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:28 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:29.046551 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e149be8c-9925-413b-8565-f0634f8bcbc3 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:29.047170 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e149be8c-9925-413b-8565-f0634f8bcbc3 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:29.054227 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e149be8c-9925-413b-8565-f0634f8bcbc3 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:29.054716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e149be8c-9925-413b-8565-f0634f8bcbc3 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:29.055156 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e149be8c-9925-413b-8565-f0634f8bcbc3 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:29.055854 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e149be8c-9925-413b-8565-f0634f8bcbc3 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:29.056311 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e149be8c-9925-413b-8565-f0634f8bcbc3 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:29.056775 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e149be8c-9925-413b-8565-f0634f8bcbc3 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:29.188377 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e149be8c-9925-413b-8565-f0634f8bcbc3 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:29.197168 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e149be8c-9925-413b-8565-f0634f8bcbc3 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1700 microversion: 2.1 time: 0.154497 Aug 05 20:14:29.197744 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 552/1125] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:29 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1700 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:29.217346 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-da1b3d63-b2ec-4100-9604-b1a0d835e923 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:14:29.223971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-da1b3d63-b2ec-4100-9604-b1a0d835e923 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:29.224455 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-da1b3d63-b2ec-4100-9604-b1a0d835e923 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:29.224923 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-da1b3d63-b2ec-4100-9604-b1a0d835e923 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:29.286180 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-da1b3d63-b2ec-4100-9604-b1a0d835e923 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Going to try to start instance {{(pid=118192) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 05 20:14:29.328890 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-da1b3d63-b2ec-4100-9604-b1a0d835e923 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "POST /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0/action" status: 202 len: 0 microversion: 2.1 time: 0.115052 Aug 05 20:14:29.329415 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 574/1126] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Aug 5 20:14:29 2022] POST /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:14:29.337337 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-5d6b68ce-83ff-4429-b316-c90e818bede7 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:29.337952 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-5d6b68ce-83ff-4429-b316-c90e818bede7 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:29.343835 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5d6b68ce-83ff-4429-b316-c90e818bede7 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:29.344324 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5d6b68ce-83ff-4429-b316-c90e818bede7 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:29.344804 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5d6b68ce-83ff-4429-b316-c90e818bede7 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:29.345496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5d6b68ce-83ff-4429-b316-c90e818bede7 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:29.345955 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5d6b68ce-83ff-4429-b316-c90e818bede7 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:29.346385 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5d6b68ce-83ff-4429-b316-c90e818bede7 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:29.439359 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-f6d08254-9015-4d6e-9264-74718e18a092 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:29.440286 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-f6d08254-9015-4d6e-9264-74718e18a092 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:29.447237 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f6d08254-9015-4d6e-9264-74718e18a092 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:29.447796 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f6d08254-9015-4d6e-9264-74718e18a092 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:29.448346 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f6d08254-9015-4d6e-9264-74718e18a092 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:29.449100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f6d08254-9015-4d6e-9264-74718e18a092 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:29.449554 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f6d08254-9015-4d6e-9264-74718e18a092 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:29.449976 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f6d08254-9015-4d6e-9264-74718e18a092 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:29.476864 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-5d6b68ce-83ff-4429-b316-c90e818bede7 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:29.484924 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-5d6b68ce-83ff-4429-b316-c90e818bede7 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1709 microversion: 2.1 time: 0.151314 Aug 05 20:14:29.485676 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 553/1127] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:29 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1709 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:29.586260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-f6d08254-9015-4d6e-9264-74718e18a092 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:29.594259 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-f6d08254-9015-4d6e-9264-74718e18a092 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:29.595767 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-f6d08254-9015-4d6e-9264-74718e18a092 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:29.596955 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-f6d08254-9015-4d6e-9264-74718e18a092 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1731 microversion: 2.20 time: 0.161929 Aug 05 20:14:29.597522 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 575/1128] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:29 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:14:30.506399 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-29142b30-6e72-464c-8c7e-62a47696c769 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:30.506949 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-29142b30-6e72-464c-8c7e-62a47696c769 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:30.515374 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-29142b30-6e72-464c-8c7e-62a47696c769 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:30.515869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-29142b30-6e72-464c-8c7e-62a47696c769 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:30.516310 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-29142b30-6e72-464c-8c7e-62a47696c769 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:30.517307 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-29142b30-6e72-464c-8c7e-62a47696c769 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:30.517763 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-29142b30-6e72-464c-8c7e-62a47696c769 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:30.518192 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-29142b30-6e72-464c-8c7e-62a47696c769 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:30.619884 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-7d410045-36b0-4a78-898c-41d2ccbce2d7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:30.620520 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-7d410045-36b0-4a78-898c-41d2ccbce2d7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:30.626973 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7d410045-36b0-4a78-898c-41d2ccbce2d7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:30.627465 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7d410045-36b0-4a78-898c-41d2ccbce2d7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:30.627903 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7d410045-36b0-4a78-898c-41d2ccbce2d7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:30.628691 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7d410045-36b0-4a78-898c-41d2ccbce2d7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:30.629925 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7d410045-36b0-4a78-898c-41d2ccbce2d7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:30.630367 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7d410045-36b0-4a78-898c-41d2ccbce2d7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:30.653016 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-29142b30-6e72-464c-8c7e-62a47696c769 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:30.661545 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-29142b30-6e72-464c-8c7e-62a47696c769 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1709 microversion: 2.1 time: 0.159314 Aug 05 20:14:30.662125 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 554/1129] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:30 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1709 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:30.765809 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-7d410045-36b0-4a78-898c-41d2ccbce2d7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:30.773999 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-7d410045-36b0-4a78-898c-41d2ccbce2d7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:30.775495 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-7d410045-36b0-4a78-898c-41d2ccbce2d7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:30.776661 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-7d410045-36b0-4a78-898c-41d2ccbce2d7 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1731 microversion: 2.20 time: 0.160660 Aug 05 20:14:30.777214 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 576/1130] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:30 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:14:31.683979 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-8f03ad61-f95f-4668-b466-8f6a0a886327 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:31.684651 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-8f03ad61-f95f-4668-b466-8f6a0a886327 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:31.691065 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8f03ad61-f95f-4668-b466-8f6a0a886327 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:31.692587 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8f03ad61-f95f-4668-b466-8f6a0a886327 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:31.693052 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8f03ad61-f95f-4668-b466-8f6a0a886327 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:31.693748 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8f03ad61-f95f-4668-b466-8f6a0a886327 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:31.694203 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8f03ad61-f95f-4668-b466-8f6a0a886327 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:31.694626 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8f03ad61-f95f-4668-b466-8f6a0a886327 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:31.799231 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-526368e5-39e2-462c-b9c1-d62e6cda851d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:31.801329 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-526368e5-39e2-462c-b9c1-d62e6cda851d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:31.807843 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-526368e5-39e2-462c-b9c1-d62e6cda851d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:31.808675 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-526368e5-39e2-462c-b9c1-d62e6cda851d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:31.809230 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-526368e5-39e2-462c-b9c1-d62e6cda851d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:31.810031 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-526368e5-39e2-462c-b9c1-d62e6cda851d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:31.810809 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-526368e5-39e2-462c-b9c1-d62e6cda851d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:31.811301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-526368e5-39e2-462c-b9c1-d62e6cda851d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:31.830130 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8f03ad61-f95f-4668-b466-8f6a0a886327 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:31.839030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-8f03ad61-f95f-4668-b466-8f6a0a886327 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1709 microversion: 2.1 time: 0.158810 Aug 05 20:14:31.839707 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 555/1131] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:31 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1709 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:31.944364 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-526368e5-39e2-462c-b9c1-d62e6cda851d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:31.952338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-526368e5-39e2-462c-b9c1-d62e6cda851d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:31.953868 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-526368e5-39e2-462c-b9c1-d62e6cda851d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:31.955030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-526368e5-39e2-462c-b9c1-d62e6cda851d tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1731 microversion: 2.20 time: 0.159650 Aug 05 20:14:31.955590 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 577/1132] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:31 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:14:32.073055 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:14:32.073249 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Fri Aug 5 20:14:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:14:32.861168 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3e113281-3055-426a-8bf9-761dedc40984 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:32.861945 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-3e113281-3055-426a-8bf9-761dedc40984 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:32.868909 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e113281-3055-426a-8bf9-761dedc40984 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:32.869399 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e113281-3055-426a-8bf9-761dedc40984 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:32.869833 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e113281-3055-426a-8bf9-761dedc40984 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:32.870666 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e113281-3055-426a-8bf9-761dedc40984 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:32.871119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e113281-3055-426a-8bf9-761dedc40984 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:32.871540 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3e113281-3055-426a-8bf9-761dedc40984 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:32.978546 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-475bf708-2626-4351-af0d-de445e192375 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:32.979156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-475bf708-2626-4351-af0d-de445e192375 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:32.985588 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-475bf708-2626-4351-af0d-de445e192375 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:32.986071 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-475bf708-2626-4351-af0d-de445e192375 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:32.986505 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-475bf708-2626-4351-af0d-de445e192375 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:32.987199 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-475bf708-2626-4351-af0d-de445e192375 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:32.987648 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-475bf708-2626-4351-af0d-de445e192375 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:32.988065 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-475bf708-2626-4351-af0d-de445e192375 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:33.013050 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3e113281-3055-426a-8bf9-761dedc40984 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:33.021977 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3e113281-3055-426a-8bf9-761dedc40984 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1713 microversion: 2.1 time: 0.164768 Aug 05 20:14:33.022542 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 556/1133] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:14:32 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1713 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:14:33.119577 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-475bf708-2626-4351-af0d-de445e192375 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:33.127507 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-475bf708-2626-4351-af0d-de445e192375 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:33.129556 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-475bf708-2626-4351-af0d-de445e192375 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:33.130804 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-475bf708-2626-4351-af0d-de445e192375 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1731 microversion: 2.20 time: 0.156132 Aug 05 20:14:33.131362 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 578/1134] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:32 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:14:34.058566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-ce0529bf-1f21-4daa-b039-34905c425d3f req-000b3021-ab22-466c-ba4f-a23c0c69ba7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4869087-6b2c-466b-beb3-36ad64c5d5eb", "name": "network-vif-plugged", "status": "completed", "tag": "13a23b2f-953f-46e0-b2af-1d2023dbbe54"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:14:34.071054 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-ce0529bf-1f21-4daa-b039-34905c425d3f req-000b3021-ab22-466c-ba4f-a23c0c69ba7a service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:34.071905 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-ce0529bf-1f21-4daa-b039-34905c425d3f req-000b3021-ab22-466c-ba4f-a23c0c69ba7a service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:34.072353 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-ce0529bf-1f21-4daa-b039-34905c425d3f req-000b3021-ab22-466c-ba4f-a23c0c69ba7a service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:34.084018 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-ce0529bf-1f21-4daa-b039-34905c425d3f req-000b3021-ab22-466c-ba4f-a23c0c69ba7a service nova] Creating event network-vif-plugged:13a23b2f-953f-46e0-b2af-1d2023dbbe54 for instance e4869087-6b2c-466b-beb3-36ad64c5d5eb on hv-cinder-85221 Aug 05 20:14:34.089262 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-ce0529bf-1f21-4daa-b039-34905c425d3f req-000b3021-ab22-466c-ba4f-a23c0c69ba7a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034402 Aug 05 20:14:34.090245 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 557/1135] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:14:34.154559 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-9b018661-d96c-4f4c-823e-84d4da0e7642 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:34.155209 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-9b018661-d96c-4f4c-823e-84d4da0e7642 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:34.162408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9b018661-d96c-4f4c-823e-84d4da0e7642 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:34.162897 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9b018661-d96c-4f4c-823e-84d4da0e7642 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:34.163332 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9b018661-d96c-4f4c-823e-84d4da0e7642 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:34.164029 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9b018661-d96c-4f4c-823e-84d4da0e7642 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:34.164485 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9b018661-d96c-4f4c-823e-84d4da0e7642 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:34.164951 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9b018661-d96c-4f4c-823e-84d4da0e7642 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:34.306637 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-9b018661-d96c-4f4c-823e-84d4da0e7642 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:34.314639 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-9b018661-d96c-4f4c-823e-84d4da0e7642 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:34.316495 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-9b018661-d96c-4f4c-823e-84d4da0e7642 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:34.317767 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-9b018661-d96c-4f4c-823e-84d4da0e7642 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1731 microversion: 2.20 time: 0.167153 Aug 05 20:14:34.318320 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 579/1136] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:34 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:35.343235 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-76348d6e-9614-45dd-a02c-3c2c46ad64ff tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:35.343950 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-76348d6e-9614-45dd-a02c-3c2c46ad64ff tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:35.351076 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-76348d6e-9614-45dd-a02c-3c2c46ad64ff tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:35.351564 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-76348d6e-9614-45dd-a02c-3c2c46ad64ff tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:35.352006 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-76348d6e-9614-45dd-a02c-3c2c46ad64ff tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:35.352732 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-76348d6e-9614-45dd-a02c-3c2c46ad64ff tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:35.353194 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-76348d6e-9614-45dd-a02c-3c2c46ad64ff tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:35.353622 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-76348d6e-9614-45dd-a02c-3c2c46ad64ff tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:35.487881 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-76348d6e-9614-45dd-a02c-3c2c46ad64ff tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:35.496512 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-76348d6e-9614-45dd-a02c-3c2c46ad64ff tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:35.498111 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-76348d6e-9614-45dd-a02c-3c2c46ad64ff tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:35.499273 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-76348d6e-9614-45dd-a02c-3c2c46ad64ff tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1731 microversion: 2.20 time: 0.160324 Aug 05 20:14:35.499835 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 558/1137] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:35 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:36.523639 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-39a0089e-e75d-4ddd-b06b-26c84829726c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:36.524360 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-39a0089e-e75d-4ddd-b06b-26c84829726c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:36.532536 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-39a0089e-e75d-4ddd-b06b-26c84829726c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:36.533052 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-39a0089e-e75d-4ddd-b06b-26c84829726c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:36.533486 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-39a0089e-e75d-4ddd-b06b-26c84829726c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:36.534178 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-39a0089e-e75d-4ddd-b06b-26c84829726c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:36.534764 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-39a0089e-e75d-4ddd-b06b-26c84829726c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:36.535279 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-39a0089e-e75d-4ddd-b06b-26c84829726c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:36.694308 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-39a0089e-e75d-4ddd-b06b-26c84829726c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:36.702369 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-39a0089e-e75d-4ddd-b06b-26c84829726c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:36.703888 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-39a0089e-e75d-4ddd-b06b-26c84829726c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:36.705127 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-39a0089e-e75d-4ddd-b06b-26c84829726c tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1731 microversion: 2.20 time: 0.186317 Aug 05 20:14:36.705693 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 580/1138] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:36 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:37.730806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-065f0cef-649e-46f2-90d9-a73dd0f497b1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:37.731358 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-065f0cef-649e-46f2-90d9-a73dd0f497b1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:37.737931 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-065f0cef-649e-46f2-90d9-a73dd0f497b1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:37.738423 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-065f0cef-649e-46f2-90d9-a73dd0f497b1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:37.738860 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-065f0cef-649e-46f2-90d9-a73dd0f497b1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:37.739849 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-065f0cef-649e-46f2-90d9-a73dd0f497b1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:37.744127 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-065f0cef-649e-46f2-90d9-a73dd0f497b1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:37.744127 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-065f0cef-649e-46f2-90d9-a73dd0f497b1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:37.874850 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-065f0cef-649e-46f2-90d9-a73dd0f497b1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:37.884117 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-065f0cef-649e-46f2-90d9-a73dd0f497b1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:37.885631 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-065f0cef-649e-46f2-90d9-a73dd0f497b1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:14:37.886782 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-065f0cef-649e-46f2-90d9-a73dd0f497b1 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1718 microversion: 2.20 time: 0.159998 Aug 05 20:14:37.887371 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 559/1139] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:14:37 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:14:52.160353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-3f768a50-2ffc-4632-a222-afbeaf0ad9ed tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:14:52.161676 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-3f768a50-2ffc-4632-a222-afbeaf0ad9ed tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:52.166606 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=31 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:14:52.167670 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:14:52.176639 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3f768a50-2ffc-4632-a222-afbeaf0ad9ed tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:52.177143 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3f768a50-2ffc-4632-a222-afbeaf0ad9ed tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:52.177583 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3f768a50-2ffc-4632-a222-afbeaf0ad9ed tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:52.178739 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3f768a50-2ffc-4632-a222-afbeaf0ad9ed tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:52.179455 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3f768a50-2ffc-4632-a222-afbeaf0ad9ed tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:52.179572 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3f768a50-2ffc-4632-a222-afbeaf0ad9ed tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:52.205609 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-3f768a50-2ffc-4632-a222-afbeaf0ad9ed tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481/ips" status: 200 len: 149 microversion: 2.1 time: 0.051725 Aug 05 20:14:52.206191 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 581/1140] 10.222.0.39 () {58 vars in 1248 bytes} [Fri Aug 5 20:14:52 2022] GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481/ips => generated 149 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:14:53.564735 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3998c35e-d4c9-4f73-a8d1-2ab3ff27ff47 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28b612be-7fb8-404b-bc97-6890cbd42098"}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:14:53.567151 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-3998c35e-d4c9-4f73-a8d1-2ab3ff27ff47 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:14:53.569469 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=29 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:14:53.570334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=96 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:14:53.576173 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3998c35e-d4c9-4f73-a8d1-2ab3ff27ff47 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:53.576723 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3998c35e-d4c9-4f73-a8d1-2ab3ff27ff47 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:53.577193 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3998c35e-d4c9-4f73-a8d1-2ab3ff27ff47 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:53.577907 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3998c35e-d4c9-4f73-a8d1-2ab3ff27ff47 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:14:53.578390 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3998c35e-d4c9-4f73-a8d1-2ab3ff27ff47 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:14:53.578829 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3998c35e-d4c9-4f73-a8d1-2ab3ff27ff47 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:14:53.885145 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3998c35e-d4c9-4f73-a8d1-2ab3ff27ff47 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "POST /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324373 Aug 05 20:14:53.885855 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 560/1141] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Aug 5 20:14:53 2022] POST /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:15:02.591432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-2db7a353-7dca-43b6-adbb-d6395a046c37 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:02.591991 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-2db7a353-7dca-43b6-adbb-d6395a046c37 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:02.594103 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=2 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:02.594761 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=4 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:02.600179 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2db7a353-7dca-43b6-adbb-d6395a046c37 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:02.600690 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2db7a353-7dca-43b6-adbb-d6395a046c37 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:02.601130 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2db7a353-7dca-43b6-adbb-d6395a046c37 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:02.601824 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2db7a353-7dca-43b6-adbb-d6395a046c37 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:02.602283 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2db7a353-7dca-43b6-adbb-d6395a046c37 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:02.602708 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2db7a353-7dca-43b6-adbb-d6395a046c37 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:02.684036 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.objects.instance [None req-2db7a353-7dca-43b6-adbb-d6395a046c37 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lazy-loading 'services' on Instance uuid af477044-a719-48b8-a252-17fadffed481 {{(pid=118192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:15:02.759441 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-2db7a353-7dca-43b6-adbb-d6395a046c37 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "DELETE /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481/os-volume_attachments/28b612be-7fb8-404b-bc97-6890cbd42098" status: 202 len: 0 microversion: 2.1 time: 0.171693 Aug 05 20:15:02.760246 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 582/1142] 10.222.0.39 () {58 vars in 1416 bytes} [Fri Aug 5 20:15:02 2022] DELETE /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481/os-volume_attachments/28b612be-7fb8-404b-bc97-6890cbd42098 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:15:02.769749 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-62036b1f-4ea4-4c5b-8716-8433f4ad3446 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:02.772055 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-62036b1f-4ea4-4c5b-8716-8433f4ad3446 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:02.778953 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-62036b1f-4ea4-4c5b-8716-8433f4ad3446 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:02.779436 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-62036b1f-4ea4-4c5b-8716-8433f4ad3446 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:02.779950 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-62036b1f-4ea4-4c5b-8716-8433f4ad3446 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:02.780757 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-62036b1f-4ea4-4c5b-8716-8433f4ad3446 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:02.781226 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-62036b1f-4ea4-4c5b-8716-8433f4ad3446 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:02.781647 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-62036b1f-4ea4-4c5b-8716-8433f4ad3446 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:02.814200 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-62036b1f-4ea4-4c5b-8716-8433f4ad3446 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049453 Aug 05 20:15:02.814983 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 561/1143] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Aug 5 20:15:02 2022] GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:15:03.828109 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-53497cc7-8d8c-420c-b1f4-23cc48b2d0f3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:03.830408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-53497cc7-8d8c-420c-b1f4-23cc48b2d0f3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:03.836481 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53497cc7-8d8c-420c-b1f4-23cc48b2d0f3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:03.837006 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53497cc7-8d8c-420c-b1f4-23cc48b2d0f3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:03.837444 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53497cc7-8d8c-420c-b1f4-23cc48b2d0f3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:03.838150 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53497cc7-8d8c-420c-b1f4-23cc48b2d0f3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:03.838604 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53497cc7-8d8c-420c-b1f4-23cc48b2d0f3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:03.839031 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-53497cc7-8d8c-420c-b1f4-23cc48b2d0f3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:03.869012 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-53497cc7-8d8c-420c-b1f4-23cc48b2d0f3 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045039 Aug 05 20:15:03.869486 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 583/1144] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Aug 5 20:15:03 2022] GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:15:04.881368 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-846c7c2e-b26d-42f1-9bb9-54db3a406663 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:04.883508 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-846c7c2e-b26d-42f1-9bb9-54db3a406663 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:04.890264 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-846c7c2e-b26d-42f1-9bb9-54db3a406663 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:04.890738 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-846c7c2e-b26d-42f1-9bb9-54db3a406663 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:04.891166 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-846c7c2e-b26d-42f1-9bb9-54db3a406663 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:04.891843 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-846c7c2e-b26d-42f1-9bb9-54db3a406663 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:04.892285 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-846c7c2e-b26d-42f1-9bb9-54db3a406663 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:04.892988 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-846c7c2e-b26d-42f1-9bb9-54db3a406663 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:04.923485 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-846c7c2e-b26d-42f1-9bb9-54db3a406663 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046312 Aug 05 20:15:04.924032 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 562/1145] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Aug 5 20:15:04 2022] GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:15:04.985419 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-9df38af1-fd58-4a97-ae24-087ae232225e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:04.985932 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-9df38af1-fd58-4a97-ae24-087ae232225e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:04.992190 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9df38af1-fd58-4a97-ae24-087ae232225e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:04.992700 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9df38af1-fd58-4a97-ae24-087ae232225e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:04.993144 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9df38af1-fd58-4a97-ae24-087ae232225e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:04.993901 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9df38af1-fd58-4a97-ae24-087ae232225e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:04.994353 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9df38af1-fd58-4a97-ae24-087ae232225e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:04.994777 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9df38af1-fd58-4a97-ae24-087ae232225e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:05.020276 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-9df38af1-fd58-4a97-ae24-087ae232225e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Going to try to terminate instance {{(pid=118192) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:15:05.098857 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-9df38af1-fd58-4a97-ae24-087ae232225e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "DELETE /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481" status: 204 len: 0 microversion: 2.1 time: 0.116816 Aug 05 20:15:05.099537 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 584/1146] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:15:04 2022] DELETE /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:15:05.108674 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-1a504e53-ae75-499d-b2b6-0f48c5f11d13 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:05.109285 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-1a504e53-ae75-499d-b2b6-0f48c5f11d13 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:05.115240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1a504e53-ae75-499d-b2b6-0f48c5f11d13 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:05.115717 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1a504e53-ae75-499d-b2b6-0f48c5f11d13 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:05.116142 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1a504e53-ae75-499d-b2b6-0f48c5f11d13 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:05.116851 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1a504e53-ae75-499d-b2b6-0f48c5f11d13 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:05.117297 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1a504e53-ae75-499d-b2b6-0f48c5f11d13 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:05.117714 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1a504e53-ae75-499d-b2b6-0f48c5f11d13 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:05.247817 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-1a504e53-ae75-499d-b2b6-0f48c5f11d13 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:05.255333 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-1a504e53-ae75-499d-b2b6-0f48c5f11d13 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481" status: 200 len: 1680 microversion: 2.1 time: 0.151262 Aug 05 20:15:05.255895 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 563/1147] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:05 2022] GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:06.278105 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-75a2f57b-6ca9-4df3-9320-9541d68654d0 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:06.278803 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-75a2f57b-6ca9-4df3-9320-9541d68654d0 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:06.285070 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-75a2f57b-6ca9-4df3-9320-9541d68654d0 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:06.285544 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-75a2f57b-6ca9-4df3-9320-9541d68654d0 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:06.285971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-75a2f57b-6ca9-4df3-9320-9541d68654d0 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:06.286653 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-75a2f57b-6ca9-4df3-9320-9541d68654d0 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:06.287100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-75a2f57b-6ca9-4df3-9320-9541d68654d0 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:06.287520 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-75a2f57b-6ca9-4df3-9320-9541d68654d0 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:06.416515 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-75a2f57b-6ca9-4df3-9320-9541d68654d0 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:06.424617 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-75a2f57b-6ca9-4df3-9320-9541d68654d0 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481" status: 200 len: 1680 microversion: 2.1 time: 0.150854 Aug 05 20:15:06.425537 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 585/1148] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:06 2022] GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:07.447626 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-4d17e9df-c2cc-4ed3-ab40-f8b47031d9ff tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:07.448245 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-4d17e9df-c2cc-4ed3-ab40-f8b47031d9ff tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:07.454605 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4d17e9df-c2cc-4ed3-ab40-f8b47031d9ff tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:07.455084 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4d17e9df-c2cc-4ed3-ab40-f8b47031d9ff tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:07.455515 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4d17e9df-c2cc-4ed3-ab40-f8b47031d9ff tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:07.456206 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4d17e9df-c2cc-4ed3-ab40-f8b47031d9ff tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:07.456826 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4d17e9df-c2cc-4ed3-ab40-f8b47031d9ff tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:07.457265 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-4d17e9df-c2cc-4ed3-ab40-f8b47031d9ff tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:07.941920 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-4d17e9df-c2cc-4ed3-ab40-f8b47031d9ff tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:07.950683 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-4d17e9df-c2cc-4ed3-ab40-f8b47031d9ff tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481" status: 200 len: 1680 microversion: 2.1 time: 0.507966 Aug 05 20:15:07.951262 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 564/1149] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:07 2022] GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481 => generated 1680 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:08.384401 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-8629a3de-7691-4418-9d69-ecf489ccd630 req-9e5b983a-fb6a-42b0-a9d8-b4c41e744306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af477044-a719-48b8-a252-17fadffed481", "name": "network-vif-deleted", "tag": "989ecd41-305a-4cd0-8309-cff5e919eaca"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:15:08.394588 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-8629a3de-7691-4418-9d69-ecf489ccd630 req-9e5b983a-fb6a-42b0-a9d8-b4c41e744306 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:08.395070 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-8629a3de-7691-4418-9d69-ecf489ccd630 req-9e5b983a-fb6a-42b0-a9d8-b4c41e744306 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:08.395500 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-8629a3de-7691-4418-9d69-ecf489ccd630 req-9e5b983a-fb6a-42b0-a9d8-b4c41e744306 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:08.407692 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-8629a3de-7691-4418-9d69-ecf489ccd630 req-9e5b983a-fb6a-42b0-a9d8-b4c41e744306 service nova] Creating event network-vif-deleted:989ecd41-305a-4cd0-8309-cff5e919eaca for instance af477044-a719-48b8-a252-17fadffed481 on hv-cinder-85221 Aug 05 20:15:08.412564 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-8629a3de-7691-4418-9d69-ecf489ccd630 req-9e5b983a-fb6a-42b0-a9d8-b4c41e744306 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033010 Aug 05 20:15:08.417000 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 586/1150] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:15:08.971977 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-766ce60e-9a2b-4121-a6cc-f8c7f90f7593 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:08.973548 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-766ce60e-9a2b-4121-a6cc-f8c7f90f7593 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:08.980865 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-766ce60e-9a2b-4121-a6cc-f8c7f90f7593 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:08.981352 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-766ce60e-9a2b-4121-a6cc-f8c7f90f7593 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:08.981782 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-766ce60e-9a2b-4121-a6cc-f8c7f90f7593 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:08.982481 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-766ce60e-9a2b-4121-a6cc-f8c7f90f7593 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:08.983065 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-766ce60e-9a2b-4121-a6cc-f8c7f90f7593 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:08.983679 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-766ce60e-9a2b-4121-a6cc-f8c7f90f7593 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:09.018044 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-766ce60e-9a2b-4121-a6cc-f8c7f90f7593 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:09.018610 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-766ce60e-9a2b-4121-a6cc-f8c7f90f7593 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:09.019048 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-766ce60e-9a2b-4121-a6cc-f8c7f90f7593 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:09.019504 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.objects.instance [None req-766ce60e-9a2b-4121-a6cc-f8c7f90f7593 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lazy-loading 'fault' on Instance uuid af477044-a719-48b8-a252-17fadffed481 {{(pid=118191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:15:09.065982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-766ce60e-9a2b-4121-a6cc-f8c7f90f7593 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afe13c8fbb1468b8ef3d0d0c671208d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b265913f9bd46b9b36c18d567d0cf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:09.073125 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-766ce60e-9a2b-4121-a6cc-f8c7f90f7593 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481" status: 200 len: 1330 microversion: 2.1 time: 0.104883 Aug 05 20:15:09.074542 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 565/1151] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:08 2022] GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481 => generated 1330 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:10.095919 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-e9a347be-f6a2-4eae-86a7-2e93e209387f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:10.096632 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-e9a347be-f6a2-4eae-86a7-2e93e209387f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:10.103351 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e9a347be-f6a2-4eae-86a7-2e93e209387f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:10.103838 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e9a347be-f6a2-4eae-86a7-2e93e209387f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:10.104277 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e9a347be-f6a2-4eae-86a7-2e93e209387f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:10.104995 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e9a347be-f6a2-4eae-86a7-2e93e209387f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:10.105442 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e9a347be-f6a2-4eae-86a7-2e93e209387f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:10.105861 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e9a347be-f6a2-4eae-86a7-2e93e209387f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:10.119083 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-e9a347be-f6a2-4eae-86a7-2e93e209387f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] HTTP exception thrown: Instance af477044-a719-48b8-a252-17fadffed481 could not be found. Aug 05 20:15:10.120741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-e9a347be-f6a2-4eae-86a7-2e93e209387f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Request method failure captured: Aug 05 20:15:10.120741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481 HTTP/1.1 Aug 05 20:15:10.120741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:15:10.120741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:15:10.120741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:15:10.120741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 0 Aug 05 20:15:10.120741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:15:10.120741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:15:10.120741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:15:10.120741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:15:10.120741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XdntYBLdlzvV7cyFg7UZC73a9OJV17dQagpc389c8g9F6eau2Yker8zNfrWRXvHE1X0s0ayqdbHqjuJX7Cxd2dg4OAmYf40eOt9KRb9kWilSf-b7MsgEH66CO1Uwzjbe3hC1fmQKpJ9W4mMdw5ek_dNUUbduEc7m-XkxS7A18A4T74 Aug 05 20:15:10.120741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:15:10.120741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:15:10.120741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:15:10.120741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:15:10.120741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:15:10.120741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:15:10.120741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:15:10.120741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:10.120741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:15:10.120741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:15:10.122441 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5b265913f9bd46b9b36c18d567d0cf66", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:15:10.122441 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:10.122441 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:15:10.122441 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:10.122441 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:15:10.122441 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:15:10.122441 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:15:10.122441 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: 1afe13c8fbb1468b8ef3d0d0c671208d Aug 05 20:15:10.122441 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:15:10.122441 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: > Aug 05 20:15:10.122441 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Instance af477044-a719-48b8-a252-17fadffed481 could not be found. Aug 05 20:15:10.122441 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'id': 'af477044-a719-48b8-a252-17fadffed481'} Aug 05 20:15:10.123432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:15:10.123432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:10.123432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:15:10.123432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:15:10.123432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:15:10.123432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:15:10.123432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:15:10.123432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:15:10.123432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:15:10.123432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:15:10.123432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af477044-a719-48b8-a252-17fadffed481 could not be found. Aug 05 20:15:10.123432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:10.123432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:10.123432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:10.123432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:10.123432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:10.123432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:10.123432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:15:10.123432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:15:10.123432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:15:10.125080 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:15:10.125080 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:15:10.125080 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:15:10.125080 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:15:10.125080 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:15:10.125080 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:15:10.125080 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:15:10.125080 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af477044-a719-48b8-a252-17fadffed481 could not be found. Aug 05 20:15:10.125080 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:10.125080 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:10.125080 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:10.125080 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:10.125080 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:10.125080 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:10.125080 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:15:10.125080 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:15:10.125080 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af477044-a719-48b8-a252-17fadffed481 could not be found. Aug 05 20:15:10.125080 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:10.126545 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-e9a347be-f6a2-4eae-86a7-2e93e209387f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Returning 404 to user: Instance af477044-a719-48b8-a252-17fadffed481 could not be found. {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:15:10.126545 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-e9a347be-f6a2-4eae-86a7-2e93e209387f tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481" status: 404 len: 111 microversion: 2.1 time: 0.030865 Aug 05 20:15:10.126545 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 587/1152] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:10 2022] GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:15:10.130822 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e3db69e9-733e-45aa-b870-668e095d0010 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '.version_select at 0x7fe3e45b58b0>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:10.152673 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e3db69e9-733e-45aa-b870-668e095d0010 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-55715630" status: 202 len: 0 microversion: 2.1 time: 0.025470 Aug 05 20:15:10.153250 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 566/1153] 10.222.0.39 () {58 vars in 1215 bytes} [Fri Aug 5 20:15:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-55715630 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:15:12.147570 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b93094ac-6485-4801-a9a0-e649938acb9e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:12.148166 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-b93094ac-6485-4801-a9a0-e649938acb9e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:12.155109 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b93094ac-6485-4801-a9a0-e649938acb9e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:12.155601 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b93094ac-6485-4801-a9a0-e649938acb9e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:12.156041 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b93094ac-6485-4801-a9a0-e649938acb9e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:12.156762 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b93094ac-6485-4801-a9a0-e649938acb9e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:12.157217 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b93094ac-6485-4801-a9a0-e649938acb9e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:12.157641 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b93094ac-6485-4801-a9a0-e649938acb9e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:12.172676 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-b93094ac-6485-4801-a9a0-e649938acb9e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] HTTP exception thrown: Instance af477044-a719-48b8-a252-17fadffed481 could not be found. Aug 05 20:15:12.174224 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b93094ac-6485-4801-a9a0-e649938acb9e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Request method failure captured: Aug 05 20:15:12.174224 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: DELETE /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481 HTTP/1.1 Aug 05 20:15:12.174224 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:15:12.174224 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:15:12.174224 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:15:12.174224 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 0 Aug 05 20:15:12.174224 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:15:12.174224 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:15:12.174224 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:15:12.174224 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:15:12.174224 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XdntYBLdlzvV7cyFg7UZC73a9OJV17dQagpc389c8g9F6eau2Yker8zNfrWRXvHE1X0s0ayqdbHqjuJX7Cxd2dg4OAmYf40eOt9KRb9kWilSf-b7MsgEH66CO1Uwzjbe3hC1fmQKpJ9W4mMdw5ek_dNUUbduEc7m-XkxS7A18A4T74 Aug 05 20:15:12.174224 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:15:12.174224 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:15:12.174224 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:15:12.174224 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:15:12.174224 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:15:12.174224 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:15:12.174224 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:15:12.174224 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:12.174224 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:15:12.174224 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:15:12.175722 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5b265913f9bd46b9b36c18d567d0cf66", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:15:12.175722 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:12.175722 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:15:12.175722 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:12.175722 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:15:12.175722 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:15:12.175722 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:15:12.175722 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: 1afe13c8fbb1468b8ef3d0d0c671208d Aug 05 20:15:12.175722 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:15:12.175722 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: > Aug 05 20:15:12.175722 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Instance af477044-a719-48b8-a252-17fadffed481 could not be found. Aug 05 20:15:12.175722 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'id': 'af477044-a719-48b8-a252-17fadffed481'} Aug 05 20:15:12.176489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:15:12.176489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:12.176489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:15:12.176489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:15:12.176489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:15:12.176489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:15:12.176489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:15:12.176489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:15:12.176489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:15:12.176489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:15:12.176489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af477044-a719-48b8-a252-17fadffed481 could not be found. Aug 05 20:15:12.176489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:12.176489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:12.176489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:12.176489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:12.176489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:12.176489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:12.176489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:15:12.176489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:15:12.176489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:15:12.177801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:15:12.177801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:15:12.177801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:15:12.177801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:15:12.177801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:15:12.177801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:15:12.177801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:15:12.177801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:15:12.177801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:15:12.177801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af477044-a719-48b8-a252-17fadffed481 could not be found. Aug 05 20:15:12.177801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:12.177801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:12.177801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:12.177801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:12.177801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:12.177801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:12.177801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:15:12.177801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:15:12.177801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af477044-a719-48b8-a252-17fadffed481 could not be found. Aug 05 20:15:12.177801 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:12.179081 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b93094ac-6485-4801-a9a0-e649938acb9e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Returning 404 to user: Instance af477044-a719-48b8-a252-17fadffed481 could not be found. {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:15:12.179081 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b93094ac-6485-4801-a9a0-e649938acb9e tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "DELETE /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481" status: 404 len: 111 microversion: 2.1 time: 0.031877 Aug 05 20:15:12.179081 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 588/1154] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:15:12 2022] DELETE /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:15:12.185035 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-1bde899a-dd51-4c1b-9d52-3c1702582be5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:12.185651 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-1bde899a-dd51-4c1b-9d52-3c1702582be5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: af477044-a719-48b8-a252-17fadffed481] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:12.192103 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1bde899a-dd51-4c1b-9d52-3c1702582be5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:12.192618 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1bde899a-dd51-4c1b-9d52-3c1702582be5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:12.193115 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1bde899a-dd51-4c1b-9d52-3c1702582be5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:12.193805 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1bde899a-dd51-4c1b-9d52-3c1702582be5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:12.194256 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1bde899a-dd51-4c1b-9d52-3c1702582be5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:12.194677 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1bde899a-dd51-4c1b-9d52-3c1702582be5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:12.208177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-1bde899a-dd51-4c1b-9d52-3c1702582be5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] HTTP exception thrown: Instance af477044-a719-48b8-a252-17fadffed481 could not be found. Aug 05 20:15:12.209813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-1bde899a-dd51-4c1b-9d52-3c1702582be5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Request method failure captured: Aug 05 20:15:12.209813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481 HTTP/1.1 Aug 05 20:15:12.209813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:15:12.209813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:15:12.209813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:15:12.209813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:15:12.209813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:15:12.209813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:15:12.209813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:15:12.209813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:15:12.209813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XdntYBLdlzvV7cyFg7UZC73a9OJV17dQagpc389c8g9F6eau2Yker8zNfrWRXvHE1X0s0ayqdbHqjuJX7Cxd2dg4OAmYf40eOt9KRb9kWilSf-b7MsgEH66CO1Uwzjbe3hC1fmQKpJ9W4mMdw5ek_dNUUbduEc7m-XkxS7A18A4T74 Aug 05 20:15:12.209813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:15:12.209813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:15:12.209813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:15:12.209813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:15:12.209813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:15:12.209813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:15:12.209813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:15:12.209813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:12.209813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:15:12.209813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:15:12.211456 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5b265913f9bd46b9b36c18d567d0cf66", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:15:12.211456 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:12.211456 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:15:12.211456 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:12.211456 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:15:12.211456 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:15:12.211456 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:15:12.211456 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: 1afe13c8fbb1468b8ef3d0d0c671208d Aug 05 20:15:12.211456 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:15:12.211456 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: > Aug 05 20:15:12.211456 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Instance af477044-a719-48b8-a252-17fadffed481 could not be found. Aug 05 20:15:12.211456 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'id': 'af477044-a719-48b8-a252-17fadffed481'} Aug 05 20:15:12.212522 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:15:12.212522 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:12.212522 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:15:12.212522 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:15:12.212522 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:15:12.212522 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:15:12.212522 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:15:12.212522 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:15:12.212522 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:15:12.212522 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:15:12.212522 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af477044-a719-48b8-a252-17fadffed481 could not be found. Aug 05 20:15:12.212522 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:12.212522 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:12.212522 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:12.212522 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:12.212522 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:12.212522 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:12.212522 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:15:12.212522 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:15:12.212522 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:15:12.214116 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:15:12.214116 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:15:12.214116 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:15:12.214116 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:15:12.214116 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:15:12.214116 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:15:12.214116 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:15:12.214116 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af477044-a719-48b8-a252-17fadffed481 could not be found. Aug 05 20:15:12.214116 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:12.214116 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:12.214116 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:12.214116 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:12.214116 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:12.214116 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:12.214116 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:15:12.214116 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:15:12.214116 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af477044-a719-48b8-a252-17fadffed481 could not be found. Aug 05 20:15:12.214116 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:12.215936 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-1bde899a-dd51-4c1b-9d52-3c1702582be5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Returning 404 to user: Instance af477044-a719-48b8-a252-17fadffed481 could not be found. {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:15:12.215936 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-1bde899a-dd51-4c1b-9d52-3c1702582be5 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481" status: 404 len: 111 microversion: 2.1 time: 0.031036 Aug 05 20:15:12.215936 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 567/1155] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:12 2022] GET /compute/v2.1/servers/af477044-a719-48b8-a252-17fadffed481 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:15:13.348227 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-217cb801-c63e-4b02-a972-1124ac760943 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:13.348757 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-217cb801-c63e-4b02-a972-1124ac760943 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:13.355619 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-217cb801-c63e-4b02-a972-1124ac760943 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:13.356087 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-217cb801-c63e-4b02-a972-1124ac760943 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:13.356530 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-217cb801-c63e-4b02-a972-1124ac760943 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:13.357259 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-217cb801-c63e-4b02-a972-1124ac760943 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:13.357719 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-217cb801-c63e-4b02-a972-1124ac760943 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:13.358146 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-217cb801-c63e-4b02-a972-1124ac760943 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:13.371605 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-217cb801-c63e-4b02-a972-1124ac760943 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] HTTP exception thrown: Instance f4539af4-0b20-4505-801a-6adb0b19cddb could not be found. Aug 05 20:15:13.373182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-217cb801-c63e-4b02-a972-1124ac760943 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Request method failure captured: Aug 05 20:15:13.373182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: DELETE /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb HTTP/1.1 Aug 05 20:15:13.373182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:15:13.373182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:15:13.373182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:15:13.373182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 0 Aug 05 20:15:13.373182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:15:13.373182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:15:13.373182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:15:13.373182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:15:13.373182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XdntYBLdlzvV7cyFg7UZC73a9OJV17dQagpc389c8g9F6eau2Yker8zNfrWRXvHE1X0s0ayqdbHqjuJX7Cxd2dg4OAmYf40eOt9KRb9kWilSf-b7MsgEH66CO1Uwzjbe3hC1fmQKpJ9W4mMdw5ek_dNUUbduEc7m-XkxS7A18A4T74 Aug 05 20:15:13.373182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:15:13.373182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:15:13.373182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:15:13.373182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:15:13.373182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:15:13.373182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:15:13.373182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:15:13.373182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:13.373182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:15:13.373182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:15:13.374824 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5b265913f9bd46b9b36c18d567d0cf66", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:15:13.374824 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:13.374824 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:15:13.374824 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:13.374824 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:15:13.374824 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:15:13.374824 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:15:13.374824 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: 1afe13c8fbb1468b8ef3d0d0c671208d Aug 05 20:15:13.374824 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:15:13.374824 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: > Aug 05 20:15:13.374824 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Instance f4539af4-0b20-4505-801a-6adb0b19cddb could not be found. Aug 05 20:15:13.374824 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'id': 'f4539af4-0b20-4505-801a-6adb0b19cddb'} Aug 05 20:15:13.375745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:15:13.375745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:13.375745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:15:13.375745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:15:13.375745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:15:13.375745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:15:13.375745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:15:13.375745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:15:13.375745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:15:13.375745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:15:13.375745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4539af4-0b20-4505-801a-6adb0b19cddb could not be found. Aug 05 20:15:13.375745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:13.375745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:13.375745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:13.375745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:13.375745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:13.375745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:13.375745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:15:13.375745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:15:13.375745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:15:13.377297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:15:13.377297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:15:13.377297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:15:13.377297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:15:13.377297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:15:13.377297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:15:13.377297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:15:13.377297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:15:13.377297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:15:13.377297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4539af4-0b20-4505-801a-6adb0b19cddb could not be found. Aug 05 20:15:13.377297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:13.377297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:13.377297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:13.377297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:13.377297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:13.377297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:13.377297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:15:13.377297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:15:13.377297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4539af4-0b20-4505-801a-6adb0b19cddb could not be found. Aug 05 20:15:13.377297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:13.378830 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-217cb801-c63e-4b02-a972-1124ac760943 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Returning 404 to user: Instance f4539af4-0b20-4505-801a-6adb0b19cddb could not be found. {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:15:13.378830 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-217cb801-c63e-4b02-a972-1124ac760943 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb" status: 404 len: 111 microversion: 2.1 time: 0.030210 Aug 05 20:15:13.378830 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 589/1156] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:15:13 2022] DELETE /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:15:13.382966 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-64797537-d29b-427b-a58e-238414350f60 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:13.383583 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-64797537-d29b-427b-a58e-238414350f60 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: f4539af4-0b20-4505-801a-6adb0b19cddb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:13.390744 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-64797537-d29b-427b-a58e-238414350f60 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:13.391229 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-64797537-d29b-427b-a58e-238414350f60 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:13.391668 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-64797537-d29b-427b-a58e-238414350f60 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:13.392352 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-64797537-d29b-427b-a58e-238414350f60 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:13.392829 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-64797537-d29b-427b-a58e-238414350f60 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:13.393508 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-64797537-d29b-427b-a58e-238414350f60 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:13.407553 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-64797537-d29b-427b-a58e-238414350f60 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] HTTP exception thrown: Instance f4539af4-0b20-4505-801a-6adb0b19cddb could not be found. Aug 05 20:15:13.409022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-64797537-d29b-427b-a58e-238414350f60 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Request method failure captured: Aug 05 20:15:13.409022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb HTTP/1.1 Aug 05 20:15:13.409022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:15:13.409022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:15:13.409022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:15:13.409022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:15:13.409022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:15:13.409022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:15:13.409022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:15:13.409022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:15:13.409022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XdntYBLdlzvV7cyFg7UZC73a9OJV17dQagpc389c8g9F6eau2Yker8zNfrWRXvHE1X0s0ayqdbHqjuJX7Cxd2dg4OAmYf40eOt9KRb9kWilSf-b7MsgEH66CO1Uwzjbe3hC1fmQKpJ9W4mMdw5ek_dNUUbduEc7m-XkxS7A18A4T74 Aug 05 20:15:13.409022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:15:13.409022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:15:13.409022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:15:13.409022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:15:13.409022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:15:13.409022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:15:13.409022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:15:13.409022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:13.409022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:15:13.409022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:15:13.410692 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5b265913f9bd46b9b36c18d567d0cf66", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:15:13.410692 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:13.410692 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:15:13.410692 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:13.410692 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:15:13.410692 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:15:13.410692 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:15:13.410692 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: 1afe13c8fbb1468b8ef3d0d0c671208d Aug 05 20:15:13.410692 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:15:13.410692 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: > Aug 05 20:15:13.410692 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Instance f4539af4-0b20-4505-801a-6adb0b19cddb could not be found. Aug 05 20:15:13.410692 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'id': 'f4539af4-0b20-4505-801a-6adb0b19cddb'} Aug 05 20:15:13.411608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:15:13.411608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:13.411608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:15:13.411608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:15:13.411608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:15:13.411608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:15:13.411608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:15:13.411608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:15:13.411608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:15:13.411608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:15:13.411608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4539af4-0b20-4505-801a-6adb0b19cddb could not be found. Aug 05 20:15:13.411608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:13.411608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:13.411608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:13.411608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:13.411608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:13.411608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:13.411608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:15:13.411608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:15:13.411608 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:15:13.413107 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:15:13.413107 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:15:13.413107 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:15:13.413107 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:15:13.413107 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:15:13.413107 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:15:13.413107 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:15:13.413107 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4539af4-0b20-4505-801a-6adb0b19cddb could not be found. Aug 05 20:15:13.413107 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:13.413107 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:13.413107 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:13.413107 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:13.413107 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:13.413107 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:13.413107 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:15:13.413107 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:15:13.413107 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4539af4-0b20-4505-801a-6adb0b19cddb could not be found. Aug 05 20:15:13.413107 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:13.414484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-64797537-d29b-427b-a58e-238414350f60 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Returning 404 to user: Instance f4539af4-0b20-4505-801a-6adb0b19cddb could not be found. {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:15:13.414484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-64797537-d29b-427b-a58e-238414350f60 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb" status: 404 len: 111 microversion: 2.1 time: 0.031274 Aug 05 20:15:13.414484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 568/1157] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:13 2022] GET /compute/v2.1/servers/f4539af4-0b20-4505-801a-6adb0b19cddb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:15:13.418916 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-269303e2-484b-4396-bba9-9037c8c77e98 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:13.419451 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-269303e2-484b-4396-bba9-9037c8c77e98 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:13.425391 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-269303e2-484b-4396-bba9-9037c8c77e98 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:13.425877 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-269303e2-484b-4396-bba9-9037c8c77e98 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:13.426318 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-269303e2-484b-4396-bba9-9037c8c77e98 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:13.427012 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-269303e2-484b-4396-bba9-9037c8c77e98 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:13.427478 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-269303e2-484b-4396-bba9-9037c8c77e98 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:13.427910 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-269303e2-484b-4396-bba9-9037c8c77e98 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:13.442675 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-269303e2-484b-4396-bba9-9037c8c77e98 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] HTTP exception thrown: Instance 2c68719b-222e-48b2-9ce7-55ed27758263 could not be found. Aug 05 20:15:13.443030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-269303e2-484b-4396-bba9-9037c8c77e98 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Request method failure captured: Aug 05 20:15:13.443030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: DELETE /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 HTTP/1.1 Aug 05 20:15:13.443030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:15:13.443030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:15:13.443030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:15:13.443030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 0 Aug 05 20:15:13.443030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:15:13.443030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:15:13.443030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:15:13.443030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:15:13.443030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XdntYBLdlzvV7cyFg7UZC73a9OJV17dQagpc389c8g9F6eau2Yker8zNfrWRXvHE1X0s0ayqdbHqjuJX7Cxd2dg4OAmYf40eOt9KRb9kWilSf-b7MsgEH66CO1Uwzjbe3hC1fmQKpJ9W4mMdw5ek_dNUUbduEc7m-XkxS7A18A4T74 Aug 05 20:15:13.443030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:15:13.443030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:15:13.443030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:15:13.443030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:15:13.443030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:15:13.443030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:15:13.443030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:15:13.443030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:13.443030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:15:13.443030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:15:13.444707 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5b265913f9bd46b9b36c18d567d0cf66", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:15:13.444707 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:13.444707 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:15:13.444707 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:13.444707 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:15:13.444707 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:15:13.444707 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:15:13.444707 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: 1afe13c8fbb1468b8ef3d0d0c671208d Aug 05 20:15:13.444707 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:15:13.444707 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: > Aug 05 20:15:13.444707 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Instance 2c68719b-222e-48b2-9ce7-55ed27758263 could not be found. Aug 05 20:15:13.444707 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'id': '2c68719b-222e-48b2-9ce7-55ed27758263'} Aug 05 20:15:13.445633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:15:13.445633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:13.445633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:15:13.445633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:15:13.445633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:15:13.445633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:15:13.445633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:15:13.445633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:15:13.445633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:15:13.445633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:15:13.445633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c68719b-222e-48b2-9ce7-55ed27758263 could not be found. Aug 05 20:15:13.445633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:13.445633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:13.445633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:13.445633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:13.445633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:13.445633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:13.445633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:15:13.445633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:15:13.445633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:15:13.448204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:15:13.448204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:15:13.448204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:15:13.448204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:15:13.448204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:15:13.448204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:15:13.448204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:15:13.448204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:15:13.448204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:15:13.448204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c68719b-222e-48b2-9ce7-55ed27758263 could not be found. Aug 05 20:15:13.448204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:13.448204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:13.448204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:13.448204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:13.448204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:13.448204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:13.448204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:15:13.448204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:15:13.448204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c68719b-222e-48b2-9ce7-55ed27758263 could not be found. Aug 05 20:15:13.448204 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:13.450313 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-269303e2-484b-4396-bba9-9037c8c77e98 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Returning 404 to user: Instance 2c68719b-222e-48b2-9ce7-55ed27758263 could not be found. {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:15:13.450313 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-269303e2-484b-4396-bba9-9037c8c77e98 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 404 len: 111 microversion: 2.1 time: 0.029522 Aug 05 20:15:13.450313 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 590/1158] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:15:13 2022] DELETE /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:15:13.453918 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7a41294e-2a28-4439-8e89-beba08d7c343 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:13.454535 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-7a41294e-2a28-4439-8e89-beba08d7c343 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 2c68719b-222e-48b2-9ce7-55ed27758263] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:13.460592 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7a41294e-2a28-4439-8e89-beba08d7c343 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:13.461086 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7a41294e-2a28-4439-8e89-beba08d7c343 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:13.461520 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7a41294e-2a28-4439-8e89-beba08d7c343 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:13.462830 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7a41294e-2a28-4439-8e89-beba08d7c343 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:13.463287 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7a41294e-2a28-4439-8e89-beba08d7c343 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:13.463713 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7a41294e-2a28-4439-8e89-beba08d7c343 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:13.477066 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-7a41294e-2a28-4439-8e89-beba08d7c343 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] HTTP exception thrown: Instance 2c68719b-222e-48b2-9ce7-55ed27758263 could not be found. Aug 05 20:15:13.478705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7a41294e-2a28-4439-8e89-beba08d7c343 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Request method failure captured: Aug 05 20:15:13.478705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 HTTP/1.1 Aug 05 20:15:13.478705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:15:13.478705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:15:13.478705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:15:13.478705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:15:13.478705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:15:13.478705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:15:13.478705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:15:13.478705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:15:13.478705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XdntYBLdlzvV7cyFg7UZC73a9OJV17dQagpc389c8g9F6eau2Yker8zNfrWRXvHE1X0s0ayqdbHqjuJX7Cxd2dg4OAmYf40eOt9KRb9kWilSf-b7MsgEH66CO1Uwzjbe3hC1fmQKpJ9W4mMdw5ek_dNUUbduEc7m-XkxS7A18A4T74 Aug 05 20:15:13.478705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:15:13.478705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:15:13.478705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:15:13.478705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:15:13.478705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:15:13.478705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:15:13.478705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:15:13.478705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:13.478705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:15:13.478705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:15:13.480470 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5b265913f9bd46b9b36c18d567d0cf66", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:15:13.480470 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:13.480470 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:15:13.480470 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:13.480470 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:15:13.480470 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:15:13.480470 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:15:13.480470 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: 1afe13c8fbb1468b8ef3d0d0c671208d Aug 05 20:15:13.480470 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:15:13.480470 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: > Aug 05 20:15:13.480470 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Instance 2c68719b-222e-48b2-9ce7-55ed27758263 could not be found. Aug 05 20:15:13.480470 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'id': '2c68719b-222e-48b2-9ce7-55ed27758263'} Aug 05 20:15:13.481315 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:15:13.481315 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:13.481315 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:15:13.481315 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:15:13.481315 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:15:13.481315 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:15:13.481315 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:15:13.481315 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:15:13.481315 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:15:13.481315 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:15:13.481315 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c68719b-222e-48b2-9ce7-55ed27758263 could not be found. Aug 05 20:15:13.481315 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:13.481315 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:13.481315 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:13.481315 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:13.481315 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:13.481315 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:13.481315 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:15:13.481315 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:15:13.481315 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:15:13.482650 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:15:13.482650 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:15:13.482650 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:15:13.482650 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:15:13.482650 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:15:13.482650 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:15:13.482650 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:15:13.482650 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c68719b-222e-48b2-9ce7-55ed27758263 could not be found. Aug 05 20:15:13.482650 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:13.482650 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:13.482650 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:13.482650 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:13.482650 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:13.482650 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:13.482650 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:15:13.482650 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:15:13.482650 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c68719b-222e-48b2-9ce7-55ed27758263 could not be found. Aug 05 20:15:13.482650 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:13.483775 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7a41294e-2a28-4439-8e89-beba08d7c343 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Returning 404 to user: Instance 2c68719b-222e-48b2-9ce7-55ed27758263 could not be found. {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:15:13.483775 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-7a41294e-2a28-4439-8e89-beba08d7c343 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263" status: 404 len: 111 microversion: 2.1 time: 0.030041 Aug 05 20:15:13.483775 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 569/1159] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:13 2022] GET /compute/v2.1/servers/2c68719b-222e-48b2-9ce7-55ed27758263 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:15:14.619994 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-70b993b1-3847-42bc-990e-33b2a9011c30 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:14.621256 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-70b993b1-3847-42bc-990e-33b2a9011c30 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:14.627626 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-70b993b1-3847-42bc-990e-33b2a9011c30 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:14.628110 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-70b993b1-3847-42bc-990e-33b2a9011c30 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:14.628548 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-70b993b1-3847-42bc-990e-33b2a9011c30 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:14.629268 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-70b993b1-3847-42bc-990e-33b2a9011c30 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:14.629726 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-70b993b1-3847-42bc-990e-33b2a9011c30 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:14.630156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-70b993b1-3847-42bc-990e-33b2a9011c30 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:14.644202 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-70b993b1-3847-42bc-990e-33b2a9011c30 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] HTTP exception thrown: Instance 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 could not be found. Aug 05 20:15:14.645800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-70b993b1-3847-42bc-990e-33b2a9011c30 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Request method failure captured: Aug 05 20:15:14.645800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: DELETE /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 HTTP/1.1 Aug 05 20:15:14.645800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:15:14.645800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:15:14.645800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:15:14.645800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 0 Aug 05 20:15:14.645800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:15:14.645800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:15:14.645800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:15:14.645800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:15:14.645800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XdntYBLdlzvV7cyFg7UZC73a9OJV17dQagpc389c8g9F6eau2Yker8zNfrWRXvHE1X0s0ayqdbHqjuJX7Cxd2dg4OAmYf40eOt9KRb9kWilSf-b7MsgEH66CO1Uwzjbe3hC1fmQKpJ9W4mMdw5ek_dNUUbduEc7m-XkxS7A18A4T74 Aug 05 20:15:14.645800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:15:14.645800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:15:14.645800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:15:14.645800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:15:14.645800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:15:14.645800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:15:14.645800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:15:14.645800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:14.645800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:15:14.645800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:15:14.647475 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5b265913f9bd46b9b36c18d567d0cf66", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:15:14.647475 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:14.647475 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:15:14.647475 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:14.647475 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:15:14.647475 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:15:14.647475 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:15:14.647475 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: 1afe13c8fbb1468b8ef3d0d0c671208d Aug 05 20:15:14.647475 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:15:14.647475 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: > Aug 05 20:15:14.647475 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Instance 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 could not be found. Aug 05 20:15:14.647475 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'id': '24ea172c-d11f-41e4-80d8-3f3e5f67cf90'} Aug 05 20:15:14.648342 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:15:14.648342 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:14.648342 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:15:14.648342 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:15:14.648342 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:15:14.648342 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:15:14.648342 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:15:14.648342 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:15:14.648342 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:15:14.648342 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:15:14.648342 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 could not be found. Aug 05 20:15:14.648342 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:14.648342 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:14.648342 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:14.648342 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:14.648342 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:14.648342 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:14.648342 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:15:14.648342 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:15:14.648342 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:15:14.649718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:15:14.649718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:15:14.649718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:15:14.649718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:15:14.649718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:15:14.649718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:15:14.649718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:15:14.649718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:15:14.649718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:15:14.649718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 could not be found. Aug 05 20:15:14.649718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:14.649718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:14.649718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:14.649718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:14.649718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:14.649718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:14.649718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:15:14.649718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:15:14.649718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 could not be found. Aug 05 20:15:14.649718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:14.651376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-70b993b1-3847-42bc-990e-33b2a9011c30 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Returning 404 to user: Instance 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 could not be found. {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:15:14.651376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-70b993b1-3847-42bc-990e-33b2a9011c30 tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "DELETE /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 404 len: 111 microversion: 2.1 time: 0.031031 Aug 05 20:15:14.651376 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 591/1160] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:15:14 2022] DELETE /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:15:14.655564 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-eb83fd0a-b95c-44bb-aabf-aacf075c984d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:14.656241 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-eb83fd0a-b95c-44bb-aabf-aacf075c984d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] [instance: 24ea172c-d11f-41e4-80d8-3f3e5f67cf90] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:14.662712 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eb83fd0a-b95c-44bb-aabf-aacf075c984d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:14.663194 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eb83fd0a-b95c-44bb-aabf-aacf075c984d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:14.663634 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eb83fd0a-b95c-44bb-aabf-aacf075c984d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:14.664324 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eb83fd0a-b95c-44bb-aabf-aacf075c984d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:14.664809 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eb83fd0a-b95c-44bb-aabf-aacf075c984d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:14.665234 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eb83fd0a-b95c-44bb-aabf-aacf075c984d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:14.678624 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-eb83fd0a-b95c-44bb-aabf-aacf075c984d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] HTTP exception thrown: Instance 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 could not be found. Aug 05 20:15:14.680240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-eb83fd0a-b95c-44bb-aabf-aacf075c984d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Request method failure captured: Aug 05 20:15:14.680240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 HTTP/1.1 Aug 05 20:15:14.680240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:15:14.680240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:15:14.680240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:15:14.680240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:15:14.680240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:15:14.680240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:15:14.680240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:15:14.680240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:15:14.680240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XdntYBLdlzvV7cyFg7UZC73a9OJV17dQagpc389c8g9F6eau2Yker8zNfrWRXvHE1X0s0ayqdbHqjuJX7Cxd2dg4OAmYf40eOt9KRb9kWilSf-b7MsgEH66CO1Uwzjbe3hC1fmQKpJ9W4mMdw5ek_dNUUbduEc7m-XkxS7A18A4T74 Aug 05 20:15:14.680240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:15:14.680240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:15:14.680240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:15:14.680240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:15:14.680240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:15:14.680240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:15:14.680240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:15:14.680240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:14.680240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:15:14.680240 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:15:14.682135 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5b265913f9bd46b9b36c18d567d0cf66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5b265913f9bd46b9b36c18d567d0cf66", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:15:14.682135 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:14.682135 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: 5b265913f9bd46b9b36c18d567d0cf66 Aug 05 20:15:14.682135 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1114522279 Aug 05 20:15:14.682135 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:15:14.682135 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:15:14.682135 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:15:14.682135 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: 1afe13c8fbb1468b8ef3d0d0c671208d Aug 05 20:15:14.682135 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-AttachVolumeNegativeTest-1114522279-project Aug 05 20:15:14.682135 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: > Aug 05 20:15:14.682135 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Instance 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 could not be found. Aug 05 20:15:14.682135 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'id': '24ea172c-d11f-41e4-80d8-3f3e5f67cf90'} Aug 05 20:15:14.684177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:15:14.684177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:14.684177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:15:14.684177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:15:14.684177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:15:14.684177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:15:14.684177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:15:14.684177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:15:14.684177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:15:14.684177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:15:14.684177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 could not be found. Aug 05 20:15:14.684177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:14.684177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:14.684177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:14.684177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:14.684177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:14.684177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:14.684177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:15:14.684177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:15:14.684177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:15:14.685746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:15:14.685746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:15:14.685746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:15:14.685746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:15:14.685746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:15:14.685746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:15:14.685746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:15:14.685746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 could not be found. Aug 05 20:15:14.685746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:14.685746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:14.685746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:14.685746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:14.685746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:14.685746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:14.685746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:15:14.685746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:15:14.685746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 could not be found. Aug 05 20:15:14.685746 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:14.687113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-eb83fd0a-b95c-44bb-aabf-aacf075c984d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] Returning 404 to user: Instance 24ea172c-d11f-41e4-80d8-3f3e5f67cf90 could not be found. {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:15:14.687113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-eb83fd0a-b95c-44bb-aabf-aacf075c984d tempest-AttachVolumeNegativeTest-1114522279 tempest-AttachVolumeNegativeTest-1114522279-project] 10.222.0.39 "GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90" status: 404 len: 111 microversion: 2.1 time: 0.030011 Aug 05 20:15:14.687113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 570/1161] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:14 2022] GET /compute/v2.1/servers/24ea172c-d11f-41e4-80d8-3f3e5f67cf90 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:15:40.508706 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b9d735cb-f040-46fa-bf3e-e673a5d1a69f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:40.509305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-b9d735cb-f040-46fa-bf3e-e673a5d1a69f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:40.511313 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:40.511971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:40.518526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b9d735cb-f040-46fa-bf3e-e673a5d1a69f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:40.519276 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b9d735cb-f040-46fa-bf3e-e673a5d1a69f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:40.519719 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b9d735cb-f040-46fa-bf3e-e673a5d1a69f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:40.520430 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b9d735cb-f040-46fa-bf3e-e673a5d1a69f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:40.520917 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b9d735cb-f040-46fa-bf3e-e673a5d1a69f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:40.521351 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b9d735cb-f040-46fa-bf3e-e673a5d1a69f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:40.607359 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.objects.instance [None req-b9d735cb-f040-46fa-bf3e-e673a5d1a69f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lazy-loading 'services' on Instance uuid 4512b727-5582-4e39-ba18-58b3c42b79f0 {{(pid=118192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:15:40.687086 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b9d735cb-f040-46fa-bf3e-e673a5d1a69f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0/os-volume_attachments/9b266d16-9170-438b-b7ae-4811856dfc14" status: 202 len: 0 microversion: 2.1 time: 0.182386 Aug 05 20:15:40.687796 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 592/1162] 10.222.0.39 () {58 vars in 1416 bytes} [Fri Aug 5 20:15:40 2022] DELETE /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0/os-volume_attachments/9b266d16-9170-438b-b7ae-4811856dfc14 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:15:42.918568 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-ebc00704-d710-4e1c-b39f-1b6626959591 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:15:42.923814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:42.924659 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:42.937535 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ebc00704-d710-4e1c-b39f-1b6626959591 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:42.938988 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ebc00704-d710-4e1c-b39f-1b6626959591 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:42.939693 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ebc00704-d710-4e1c-b39f-1b6626959591 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:42.969906 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-ebc00704-d710-4e1c-b39f-1b6626959591 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Going to try to stop instance {{(pid=118191) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 05 20:15:43.023254 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-ebc00704-d710-4e1c-b39f-1b6626959591 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "POST /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0/action" status: 202 len: 0 microversion: 2.1 time: 0.108632 Aug 05 20:15:43.023874 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 571/1163] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Aug 5 20:15:42 2022] POST /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:15:43.041392 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-8dcb4786-b93b-492c-9e07-7c55d6b781ea tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:43.044274 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-8dcb4786-b93b-492c-9e07-7c55d6b781ea tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:43.064970 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8dcb4786-b93b-492c-9e07-7c55d6b781ea tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:43.065853 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8dcb4786-b93b-492c-9e07-7c55d6b781ea tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:43.066779 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8dcb4786-b93b-492c-9e07-7c55d6b781ea tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:43.068242 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8dcb4786-b93b-492c-9e07-7c55d6b781ea tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:43.069071 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8dcb4786-b93b-492c-9e07-7c55d6b781ea tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:43.069828 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8dcb4786-b93b-492c-9e07-7c55d6b781ea tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:43.507750 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-8dcb4786-b93b-492c-9e07-7c55d6b781ea tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:43.515595 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-8dcb4786-b93b-492c-9e07-7c55d6b781ea tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1677 microversion: 2.1 time: 0.486322 Aug 05 20:15:43.516643 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 593/1164] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:43 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1677 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:44.538621 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-0cf01420-3015-434f-a164-ca61948c361c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:44.540082 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-0cf01420-3015-434f-a164-ca61948c361c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:44.546361 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0cf01420-3015-434f-a164-ca61948c361c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:44.546847 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0cf01420-3015-434f-a164-ca61948c361c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:44.547869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0cf01420-3015-434f-a164-ca61948c361c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:44.548869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0cf01420-3015-434f-a164-ca61948c361c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:44.549329 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0cf01420-3015-434f-a164-ca61948c361c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:44.549909 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0cf01420-3015-434f-a164-ca61948c361c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:44.737649 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-0cf01420-3015-434f-a164-ca61948c361c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:44.745992 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-0cf01420-3015-434f-a164-ca61948c361c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1677 microversion: 2.1 time: 0.211968 Aug 05 20:15:44.746568 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 572/1165] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:44 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1677 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:45.756374 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-5d7784c5-a0d6-4e79-ac14-1de38f4c1f21 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:45.758474 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-5d7784c5-a0d6-4e79-ac14-1de38f4c1f21 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:45.769543 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5d7784c5-a0d6-4e79-ac14-1de38f4c1f21 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:45.770046 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5d7784c5-a0d6-4e79-ac14-1de38f4c1f21 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:45.770481 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5d7784c5-a0d6-4e79-ac14-1de38f4c1f21 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:45.771366 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5d7784c5-a0d6-4e79-ac14-1de38f4c1f21 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:45.771972 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5d7784c5-a0d6-4e79-ac14-1de38f4c1f21 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:45.772937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5d7784c5-a0d6-4e79-ac14-1de38f4c1f21 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:45.789875 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e19f149f-25d9-43af-a429-5a0f8a05ff84 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:45.790835 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e19f149f-25d9-43af-a429-5a0f8a05ff84 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:45.803183 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e19f149f-25d9-43af-a429-5a0f8a05ff84 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:45.804424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e19f149f-25d9-43af-a429-5a0f8a05ff84 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:45.805226 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e19f149f-25d9-43af-a429-5a0f8a05ff84 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:45.807018 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e19f149f-25d9-43af-a429-5a0f8a05ff84 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:45.808063 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e19f149f-25d9-43af-a429-5a0f8a05ff84 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:45.809105 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e19f149f-25d9-43af-a429-5a0f8a05ff84 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:45.814768 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-5d7784c5-a0d6-4e79-ac14-1de38f4c1f21 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.062619 Aug 05 20:15:45.816112 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 594/1166] 10.222.0.39 () {60 vars in 1343 bytes} [Fri Aug 5 20:15:45 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:45.899916 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-dca6d222-3576-43d7-b4ab-29f8439ed6a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:45.900507 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-dca6d222-3576-43d7-b4ab-29f8439ed6a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:45.907455 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dca6d222-3576-43d7-b4ab-29f8439ed6a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:45.908038 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dca6d222-3576-43d7-b4ab-29f8439ed6a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:45.908740 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dca6d222-3576-43d7-b4ab-29f8439ed6a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:45.909776 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dca6d222-3576-43d7-b4ab-29f8439ed6a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:45.910243 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dca6d222-3576-43d7-b4ab-29f8439ed6a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:45.910675 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-dca6d222-3576-43d7-b4ab-29f8439ed6a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:45.940812 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-dca6d222-3576-43d7-b4ab-29f8439ed6a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Going to try to terminate instance {{(pid=118192) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:15:46.022367 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e19f149f-25d9-43af-a429-5a0f8a05ff84 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:46.032833 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e19f149f-25d9-43af-a429-5a0f8a05ff84 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1677 microversion: 2.1 time: 0.263623 Aug 05 20:15:46.043344 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 573/1167] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:45 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1677 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:46.050362 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-dca6d222-3576-43d7-b4ab-29f8439ed6a3 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 204 len: 0 microversion: 2.20 time: 0.152942 Aug 05 20:15:46.051075 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 595/1168] 10.222.0.39 () {60 vars in 1280 bytes} [Fri Aug 5 20:15:45 2022] DELETE /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 05 20:15:46.060916 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-562519cd-8eb0-42d5-87c7-3c016afb8a3f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:46.061182 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-562519cd-8eb0-42d5-87c7-3c016afb8a3f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:46.067999 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-562519cd-8eb0-42d5-87c7-3c016afb8a3f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:46.068481 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-562519cd-8eb0-42d5-87c7-3c016afb8a3f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:46.068956 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-562519cd-8eb0-42d5-87c7-3c016afb8a3f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:46.069663 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-562519cd-8eb0-42d5-87c7-3c016afb8a3f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:46.070209 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-562519cd-8eb0-42d5-87c7-3c016afb8a3f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:46.070642 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-562519cd-8eb0-42d5-87c7-3c016afb8a3f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:46.248223 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-562519cd-8eb0-42d5-87c7-3c016afb8a3f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:46.262726 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-562519cd-8eb0-42d5-87c7-3c016afb8a3f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:46.264912 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-562519cd-8eb0-42d5-87c7-3c016afb8a3f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:46.266206 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-562519cd-8eb0-42d5-87c7-3c016afb8a3f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1724 microversion: 2.20 time: 0.209872 Aug 05 20:15:46.266769 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 574/1169] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:15:46 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:15:47.061753 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-e0f233c4-75b3-42ab-8417-26e1b5c68ab6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:47.062477 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-e0f233c4-75b3-42ab-8417-26e1b5c68ab6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:47.074227 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e0f233c4-75b3-42ab-8417-26e1b5c68ab6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:47.074723 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e0f233c4-75b3-42ab-8417-26e1b5c68ab6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:47.075307 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e0f233c4-75b3-42ab-8417-26e1b5c68ab6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:47.076161 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e0f233c4-75b3-42ab-8417-26e1b5c68ab6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:47.076645 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e0f233c4-75b3-42ab-8417-26e1b5c68ab6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:47.077073 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e0f233c4-75b3-42ab-8417-26e1b5c68ab6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:47.115133 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-61b08ddb-1c88-4f5c-8b5a-384d381a689f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-182426735", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1158990661", "security_groups": [{"name": "tempest-secgroup-smoke-1565201125"}], "block_device_mapping_v2": [{"uuid": "624ce213-df63-4095-8fcd-cc5aa09255a4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9c8ea1a5-5b07-4174-af4e-dcae22583662"}]}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:15:47.279981 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-e0f233c4-75b3-42ab-8417-26e1b5c68ab6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:47.288628 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.network.neutron [None req-61b08ddb-1c88-4f5c-8b5a-384d381a689f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] validate_networks() for [('9c8ea1a5-5b07-4174-af4e-dcae22583662', None, None, None, None, None)] {{(pid=118191) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:15:47.291857 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-e0f233c4-75b3-42ab-8417-26e1b5c68ab6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1677 microversion: 2.1 time: 0.239906 Aug 05 20:15:47.293648 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 596/1170] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:47 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1677 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:47.299767 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ebf5d3c3-7ec8-47b3-805b-50d8b6e60299 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:47.300848 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-ebf5d3c3-7ec8-47b3-805b-50d8b6e60299 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:47.330409 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ebf5d3c3-7ec8-47b3-805b-50d8b6e60299 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:47.331959 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ebf5d3c3-7ec8-47b3-805b-50d8b6e60299 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:47.332649 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ebf5d3c3-7ec8-47b3-805b-50d8b6e60299 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:47.333782 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ebf5d3c3-7ec8-47b3-805b-50d8b6e60299 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:47.334558 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ebf5d3c3-7ec8-47b3-805b-50d8b6e60299 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:47.335196 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ebf5d3c3-7ec8-47b3-805b-50d8b6e60299 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:47.572011 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-ebf5d3c3-7ec8-47b3-805b-50d8b6e60299 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:47.588027 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-ebf5d3c3-7ec8-47b3-805b-50d8b6e60299 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:47.591992 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-ebf5d3c3-7ec8-47b3-805b-50d8b6e60299 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:47.595032 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-ebf5d3c3-7ec8-47b3-805b-50d8b6e60299 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1724 microversion: 2.20 time: 0.298518 Aug 05 20:15:47.596135 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 597/1171] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:15:47 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:15:48.042806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-61b08ddb-1c88-4f5c-8b5a-384d381a689f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Flavor limits 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:15:48.043245 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-61b08ddb-1c88-4f5c-8b5a-384d381a689f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Image limits 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:15:48.043727 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-61b08ddb-1c88-4f5c-8b5a-384d381a689f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Flavor pref 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:15:48.044142 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-61b08ddb-1c88-4f5c-8b5a-384d381a689f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Image pref 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:15:48.044560 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-61b08ddb-1c88-4f5c-8b5a-384d381a689f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:15:48.059185 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-61b08ddb-1c88-4f5c-8b5a-384d381a689f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:48.059976 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-61b08ddb-1c88-4f5c-8b5a-384d381a689f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:48.060708 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-61b08ddb-1c88-4f5c-8b5a-384d381a689f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:48.061960 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-61b08ddb-1c88-4f5c-8b5a-384d381a689f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:48.063204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-61b08ddb-1c88-4f5c-8b5a-384d381a689f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:48.063885 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-61b08ddb-1c88-4f5c-8b5a-384d381a689f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:48.087185 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-61b08ddb-1c88-4f5c-8b5a-384d381a689f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Getting quotas for project cd1707d3a6c640b78baeb522cfb7ecdb. Resources: {'cores', 'ram', 'instances'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:15:48.092171 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-61b08ddb-1c88-4f5c-8b5a-384d381a689f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Getting quotas for user b5d959f3af3745ed8e0bc4a67faf34f1 and project cd1707d3a6c640b78baeb522cfb7ecdb. Resources: {'cores', 'ram', 'instances'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:15:48.170694 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-61b08ddb-1c88-4f5c-8b5a-384d381a689f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Going to run 1 instances... {{(pid=118191) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:15:48.173791 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-61b08ddb-1c88-4f5c-8b5a-384d381a689f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='624ce213-df63-4095-8fcd-cc5aa09255a4',volume_size=None,volume_type=None)] {{(pid=118191) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:15:48.318075 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-61b08ddb-1c88-4f5c-8b5a-384d381a689f tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.209016 Aug 05 20:15:48.318720 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 575/1172] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Aug 5 20:15:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 1212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:15:48.329411 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-38d9a5aa-c476-4193-a114-092096fab0bf tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:48.330467 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-38d9a5aa-c476-4193-a114-092096fab0bf tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:48.336278 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a532066c-d592-450b-82de-3eefae2c6bfa tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:48.337305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a532066c-d592-450b-82de-3eefae2c6bfa tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:48.344489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a532066c-d592-450b-82de-3eefae2c6bfa tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:48.348024 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a532066c-d592-450b-82de-3eefae2c6bfa tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:48.349460 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a532066c-d592-450b-82de-3eefae2c6bfa tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:48.350277 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a532066c-d592-450b-82de-3eefae2c6bfa tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:48.351060 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a532066c-d592-450b-82de-3eefae2c6bfa tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:48.351606 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a532066c-d592-450b-82de-3eefae2c6bfa tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:48.440816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-38d9a5aa-c476-4193-a114-092096fab0bf tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:48.455588 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-38d9a5aa-c476-4193-a114-092096fab0bf tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 200 len: 1094 microversion: 2.1 time: 0.128069 Aug 05 20:15:48.457245 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 576/1173] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:48 2022] GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 1094 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:15:48.634007 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-16f1af08-d819-45e8-a589-df0ed1b285ca tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:48.634840 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-16f1af08-d819-45e8-a589-df0ed1b285ca tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:48.648719 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-16f1af08-d819-45e8-a589-df0ed1b285ca tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:48.648719 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-16f1af08-d819-45e8-a589-df0ed1b285ca tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:48.651283 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-16f1af08-d819-45e8-a589-df0ed1b285ca tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:48.651466 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-16f1af08-d819-45e8-a589-df0ed1b285ca tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:48.651904 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-16f1af08-d819-45e8-a589-df0ed1b285ca tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:48.652335 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-16f1af08-d819-45e8-a589-df0ed1b285ca tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:48.674670 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a532066c-d592-450b-82de-3eefae2c6bfa tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:48.698504 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a532066c-d592-450b-82de-3eefae2c6bfa tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1677 microversion: 2.1 time: 0.372962 Aug 05 20:15:48.702759 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 598/1174] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:48 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1677 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:49.066893 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-16f1af08-d819-45e8-a589-df0ed1b285ca tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:49.077924 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-16f1af08-d819-45e8-a589-df0ed1b285ca tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:49.080623 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-16f1af08-d819-45e8-a589-df0ed1b285ca tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:49.082687 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-16f1af08-d819-45e8-a589-df0ed1b285ca tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1724 microversion: 2.20 time: 0.452016 Aug 05 20:15:49.083573 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 577/1175] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:15:48 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1724 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:15:49.476519 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-9b55eb42-fbd1-44ab-9914-42c66821b114 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:49.477158 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-9b55eb42-fbd1-44ab-9914-42c66821b114 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:49.485485 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9b55eb42-fbd1-44ab-9914-42c66821b114 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:49.486366 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9b55eb42-fbd1-44ab-9914-42c66821b114 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:49.487140 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9b55eb42-fbd1-44ab-9914-42c66821b114 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:49.488554 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9b55eb42-fbd1-44ab-9914-42c66821b114 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:49.489367 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9b55eb42-fbd1-44ab-9914-42c66821b114 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:49.490103 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9b55eb42-fbd1-44ab-9914-42c66821b114 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:49.587187 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-9b55eb42-fbd1-44ab-9914-42c66821b114 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:49.597480 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-9b55eb42-fbd1-44ab-9914-42c66821b114 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 200 len: 1192 microversion: 2.1 time: 0.124794 Aug 05 20:15:49.598719 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 599/1176] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:49 2022] GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 1192 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:49.732272 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-8fad38cb-83dc-4f47-b2b7-2b06ec2fd544 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:49.733275 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-8fad38cb-83dc-4f47-b2b7-2b06ec2fd544 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:49.741882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8fad38cb-83dc-4f47-b2b7-2b06ec2fd544 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:49.742800 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8fad38cb-83dc-4f47-b2b7-2b06ec2fd544 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:49.743513 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8fad38cb-83dc-4f47-b2b7-2b06ec2fd544 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:49.744523 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8fad38cb-83dc-4f47-b2b7-2b06ec2fd544 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:49.745340 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8fad38cb-83dc-4f47-b2b7-2b06ec2fd544 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:49.746029 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-8fad38cb-83dc-4f47-b2b7-2b06ec2fd544 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:49.851954 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-2c0d5519-90db-44aa-ac43-94f5cda9d6f1 req-e1fe005e-c55c-4d31-b0da-e093bd1fc2e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4869087-6b2c-466b-beb3-36ad64c5d5eb", "name": "network-vif-deleted", "tag": "13a23b2f-953f-46e0-b2af-1d2023dbbe54"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:15:49.872929 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-2c0d5519-90db-44aa-ac43-94f5cda9d6f1 req-e1fe005e-c55c-4d31-b0da-e093bd1fc2e3 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:49.878500 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-2c0d5519-90db-44aa-ac43-94f5cda9d6f1 req-e1fe005e-c55c-4d31-b0da-e093bd1fc2e3 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:49.882185 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-2c0d5519-90db-44aa-ac43-94f5cda9d6f1 req-e1fe005e-c55c-4d31-b0da-e093bd1fc2e3 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:49.952684 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-2c0d5519-90db-44aa-ac43-94f5cda9d6f1 req-e1fe005e-c55c-4d31-b0da-e093bd1fc2e3 service nova] Creating event network-vif-deleted:13a23b2f-953f-46e0-b2af-1d2023dbbe54 for instance e4869087-6b2c-466b-beb3-36ad64c5d5eb on hv-cinder-85221 Aug 05 20:15:49.966270 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-2c0d5519-90db-44aa-ac43-94f5cda9d6f1 req-e1fe005e-c55c-4d31-b0da-e093bd1fc2e3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121720 Aug 05 20:15:49.967102 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 600/1177] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:15:50.110420 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-036a029d-b5b4-4738-80ed-4689ecd13286 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:50.111474 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-036a029d-b5b4-4738-80ed-4689ecd13286 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:50.124899 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-036a029d-b5b4-4738-80ed-4689ecd13286 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:50.125628 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-036a029d-b5b4-4738-80ed-4689ecd13286 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:50.126567 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-036a029d-b5b4-4738-80ed-4689ecd13286 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:50.131435 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-036a029d-b5b4-4738-80ed-4689ecd13286 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:50.132854 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-036a029d-b5b4-4738-80ed-4689ecd13286 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:50.134453 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-036a029d-b5b4-4738-80ed-4689ecd13286 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:50.169461 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-8fad38cb-83dc-4f47-b2b7-2b06ec2fd544 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:50.198250 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-8fad38cb-83dc-4f47-b2b7-2b06ec2fd544 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1677 microversion: 2.1 time: 0.471134 Aug 05 20:15:50.224819 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 578/1178] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:49 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1677 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:50.234328 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-036a029d-b5b4-4738-80ed-4689ecd13286 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:50.235061 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-036a029d-b5b4-4738-80ed-4689ecd13286 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:50.236055 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-036a029d-b5b4-4738-80ed-4689ecd13286 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:50.238848 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.objects.instance [None req-036a029d-b5b4-4738-80ed-4689ecd13286 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lazy-loading 'fault' on Instance uuid e4869087-6b2c-466b-beb3-36ad64c5d5eb {{(pid=118192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:15:50.331403 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-036a029d-b5b4-4738-80ed-4689ecd13286 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:50.340198 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-036a029d-b5b4-4738-80ed-4689ecd13286 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:50.342745 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-036a029d-b5b4-4738-80ed-4689ecd13286 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '160c88a7ba0144d4b1bc953767b12bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4789b47e0f47b0acd1cc4919593c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:50.344778 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-036a029d-b5b4-4738-80ed-4689ecd13286 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 200 len: 1372 microversion: 2.20 time: 0.240171 Aug 05 20:15:50.346293 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 601/1179] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:15:50 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 1372 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:15:50.624369 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f686b39f-fb08-4db7-aaa5-dea6b00fa23e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:50.625297 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f686b39f-fb08-4db7-aaa5-dea6b00fa23e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:50.634048 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f686b39f-fb08-4db7-aaa5-dea6b00fa23e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:50.635706 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f686b39f-fb08-4db7-aaa5-dea6b00fa23e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:50.636561 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f686b39f-fb08-4db7-aaa5-dea6b00fa23e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:50.637530 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f686b39f-fb08-4db7-aaa5-dea6b00fa23e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:50.638227 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f686b39f-fb08-4db7-aaa5-dea6b00fa23e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:50.638916 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f686b39f-fb08-4db7-aaa5-dea6b00fa23e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:50.778224 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f686b39f-fb08-4db7-aaa5-dea6b00fa23e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:50.792767 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f686b39f-fb08-4db7-aaa5-dea6b00fa23e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 200 len: 1210 microversion: 2.1 time: 0.174984 Aug 05 20:15:50.794453 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 579/1180] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:50 2022] GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 1210 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:15:51.232143 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-92cfd6d7-3acf-43a1-9116-2f1950c7fc93 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:51.233053 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-92cfd6d7-3acf-43a1-9116-2f1950c7fc93 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:51.259608 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-92cfd6d7-3acf-43a1-9116-2f1950c7fc93 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:51.260469 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-92cfd6d7-3acf-43a1-9116-2f1950c7fc93 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:51.261728 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-92cfd6d7-3acf-43a1-9116-2f1950c7fc93 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:51.262417 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-92cfd6d7-3acf-43a1-9116-2f1950c7fc93 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:51.263225 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-92cfd6d7-3acf-43a1-9116-2f1950c7fc93 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:51.263981 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-92cfd6d7-3acf-43a1-9116-2f1950c7fc93 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:51.393045 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-32d651db-1a88-4333-b649-7e4f51cc3513 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:51.394121 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-32d651db-1a88-4333-b649-7e4f51cc3513 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:51.412412 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-32d651db-1a88-4333-b649-7e4f51cc3513 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:51.413606 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-32d651db-1a88-4333-b649-7e4f51cc3513 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:51.414382 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-32d651db-1a88-4333-b649-7e4f51cc3513 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:51.415770 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-32d651db-1a88-4333-b649-7e4f51cc3513 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:51.416571 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-32d651db-1a88-4333-b649-7e4f51cc3513 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:51.417513 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-32d651db-1a88-4333-b649-7e4f51cc3513 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:51.448793 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-32d651db-1a88-4333-b649-7e4f51cc3513 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] HTTP exception thrown: Instance e4869087-6b2c-466b-beb3-36ad64c5d5eb could not be found. Aug 05 20:15:51.453982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-32d651db-1a88-4333-b649-7e4f51cc3513 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Request method failure captured: Aug 05 20:15:51.453982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb HTTP/1.1 Aug 05 20:15:51.453982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:15:51.453982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:15:51.453982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:15:51.453982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:15:51.453982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:15:51.453982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:15:51.453982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:15:51.453982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:15:51.453982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XflUr6pMFYGyAct_pxI2Tj049c_XZuQFJMkzUqRUGwj-hQJDlurKTD3OVG5neYfGUOViwmRomj5cShcddXo6F9i8LvUsRkqgKBFJGesXbj1lG7l-7aUNEdkEIT7S3_oubonM6XBVeHzi6bRwAbwq_1FwCx4IhqPBtHseSu65ZuaPvs Aug 05 20:15:51.453982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:15:51.453982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:15:51.453982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:15:51.453982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:15:51.453982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 20:15:51.453982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:15:51.453982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:15:51.453982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: aa4789b47e0f47b0acd1cc4919593c33 Aug 05 20:15:51.453982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1646958349 Aug 05 20:15:51.453982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:15:51.453982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:15:51.456806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/aa4789b47e0f47b0acd1cc4919593c33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/aa4789b47e0f47b0acd1cc4919593c33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/aa4789b47e0f47b0acd1cc4919593c33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_aa4789b47e0f47b0acd1cc4919593c33", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:15:51.456806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1646958349 Aug 05 20:15:51.456806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: aa4789b47e0f47b0acd1cc4919593c33 Aug 05 20:15:51.456806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1646958349 Aug 05 20:15:51.456806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-AttachVolumeShelveTestJSON-1646958349-project Aug 05 20:15:51.456806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:15:51.456806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:15:51.456806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: 160c88a7ba0144d4b1bc953767b12bb7 Aug 05 20:15:51.456806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1646958349-project Aug 05 20:15:51.456806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: > Aug 05 20:15:51.456806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Instance e4869087-6b2c-466b-beb3-36ad64c5d5eb could not be found. Aug 05 20:15:51.456806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'id': 'e4869087-6b2c-466b-beb3-36ad64c5d5eb'} Aug 05 20:15:51.459068 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:15:51.459068 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:51.459068 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:15:51.459068 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:15:51.459068 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:15:51.459068 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:15:51.459068 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:15:51.459068 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:15:51.459068 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:15:51.459068 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:15:51.459068 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4869087-6b2c-466b-beb3-36ad64c5d5eb could not be found. Aug 05 20:15:51.459068 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:51.459068 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:51.459068 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:51.459068 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:51.459068 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:51.459068 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:51.459068 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:15:51.459068 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:15:51.459068 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:15:51.462994 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:15:51.462994 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:15:51.462994 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:15:51.462994 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:15:51.462994 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:15:51.462994 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:15:51.462994 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:15:51.462994 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4869087-6b2c-466b-beb3-36ad64c5d5eb could not be found. Aug 05 20:15:51.462994 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:51.462994 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:51.462994 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:51.462994 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:51.462994 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:51.462994 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:51.462994 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:15:51.462994 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:15:51.462994 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4869087-6b2c-466b-beb3-36ad64c5d5eb could not be found. Aug 05 20:15:51.462994 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:51.467967 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-32d651db-1a88-4333-b649-7e4f51cc3513 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Returning 404 to user: Instance e4869087-6b2c-466b-beb3-36ad64c5d5eb could not be found. {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:15:51.467967 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-32d651db-1a88-4333-b649-7e4f51cc3513 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 404 len: 111 microversion: 2.20 time: 0.072056 Aug 05 20:15:51.467967 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 580/1181] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:15:51 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 05 20:15:51.467967 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-1fe84d8f-7854-4aca-bca3-4c088310b5ba tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '.version_select at 0x7fe3e4fd2c10>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:51.503657 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-1fe84d8f-7854-4aca-bca3-4c088310b5ba tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1764935559" status: 204 len: 0 microversion: 2.20 time: 0.040409 Aug 05 20:15:51.505868 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 581/1182] 10.222.0.39 () {60 vars in 1262 bytes} [Fri Aug 5 20:15:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1764935559 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 20:15:51.611976 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-92cfd6d7-3acf-43a1-9116-2f1950c7fc93 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:51.637101 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-92cfd6d7-3acf-43a1-9116-2f1950c7fc93 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1677 microversion: 2.1 time: 0.407582 Aug 05 20:15:51.640348 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 602/1183] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:51 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1677 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:51.828281 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-2a7eecf9-7ca4-4ef7-87d4-e4665aa8020a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:51.829761 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-2a7eecf9-7ca4-4ef7-87d4-e4665aa8020a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:51.842806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2a7eecf9-7ca4-4ef7-87d4-e4665aa8020a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:51.843422 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2a7eecf9-7ca4-4ef7-87d4-e4665aa8020a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:51.843788 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2a7eecf9-7ca4-4ef7-87d4-e4665aa8020a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:51.844297 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2a7eecf9-7ca4-4ef7-87d4-e4665aa8020a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:51.852750 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2a7eecf9-7ca4-4ef7-87d4-e4665aa8020a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:51.853391 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2a7eecf9-7ca4-4ef7-87d4-e4665aa8020a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:52.135377 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-2a7eecf9-7ca4-4ef7-87d4-e4665aa8020a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:52.157033 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-2a7eecf9-7ca4-4ef7-87d4-e4665aa8020a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 200 len: 1266 microversion: 2.1 time: 0.332117 Aug 05 20:15:52.157637 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 582/1184] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:51 2022] GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 1266 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:52.666824 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b4a78f50-f75b-4f98-b6e6-514a1e735d9d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:52.668182 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-b4a78f50-f75b-4f98-b6e6-514a1e735d9d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:52.675480 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b4a78f50-f75b-4f98-b6e6-514a1e735d9d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:52.676369 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b4a78f50-f75b-4f98-b6e6-514a1e735d9d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:52.677108 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b4a78f50-f75b-4f98-b6e6-514a1e735d9d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:52.678097 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b4a78f50-f75b-4f98-b6e6-514a1e735d9d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:52.678670 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b4a78f50-f75b-4f98-b6e6-514a1e735d9d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:52.679194 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b4a78f50-f75b-4f98-b6e6-514a1e735d9d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:52.767004 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-1245617c-88a4-46f2-9c5b-7c7d62d8b7cc req-5afea793-6fdc-4ed2-bd2f-dd143e9896e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f346a0be-3cbc-4049-b079-576f8c9196be", "tag": "dd271ba4-7623-4f70-8dfb-7497cc0f0c3d"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:15:52.799496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-1245617c-88a4-46f2-9c5b-7c7d62d8b7cc req-5afea793-6fdc-4ed2-bd2f-dd143e9896e4 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:52.801032 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-1245617c-88a4-46f2-9c5b-7c7d62d8b7cc req-5afea793-6fdc-4ed2-bd2f-dd143e9896e4 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:52.805191 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-1245617c-88a4-46f2-9c5b-7c7d62d8b7cc req-5afea793-6fdc-4ed2-bd2f-dd143e9896e4 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:52.834791 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-1245617c-88a4-46f2-9c5b-7c7d62d8b7cc req-5afea793-6fdc-4ed2-bd2f-dd143e9896e4 service nova] Creating event network-changed:dd271ba4-7623-4f70-8dfb-7497cc0f0c3d for instance f346a0be-3cbc-4049-b079-576f8c9196be on hv-cinder-85221 Aug 05 20:15:52.857809 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-1245617c-88a4-46f2-9c5b-7c7d62d8b7cc req-5afea793-6fdc-4ed2-bd2f-dd143e9896e4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100656 Aug 05 20:15:52.859169 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 583/1185] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:15:53.016865 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-b4a78f50-f75b-4f98-b6e6-514a1e735d9d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:53.030289 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b4a78f50-f75b-4f98-b6e6-514a1e735d9d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1677 microversion: 2.1 time: 0.366892 Aug 05 20:15:53.031229 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 603/1186] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:52 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1677 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:15:53.193730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-feca9538-6bd8-4f86-a105-509d606129c0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:53.195778 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-feca9538-6bd8-4f86-a105-509d606129c0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:53.210270 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-feca9538-6bd8-4f86-a105-509d606129c0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:53.211602 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-feca9538-6bd8-4f86-a105-509d606129c0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:53.212689 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-feca9538-6bd8-4f86-a105-509d606129c0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:53.214293 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-feca9538-6bd8-4f86-a105-509d606129c0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:53.215277 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-feca9538-6bd8-4f86-a105-509d606129c0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:53.216843 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-feca9538-6bd8-4f86-a105-509d606129c0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:53.768618 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-feca9538-6bd8-4f86-a105-509d606129c0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:53.785329 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-feca9538-6bd8-4f86-a105-509d606129c0 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 200 len: 1266 microversion: 2.1 time: 0.601932 Aug 05 20:15:53.787204 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 584/1187] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:53 2022] GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 1266 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:53.996100 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b65b1839-6388-4809-9db5-0902cc4d7a28 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:53.997102 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-b65b1839-6388-4809-9db5-0902cc4d7a28 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:54.005671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b65b1839-6388-4809-9db5-0902cc4d7a28 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:54.006158 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b65b1839-6388-4809-9db5-0902cc4d7a28 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:54.006595 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b65b1839-6388-4809-9db5-0902cc4d7a28 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:54.007302 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b65b1839-6388-4809-9db5-0902cc4d7a28 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:54.007889 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b65b1839-6388-4809-9db5-0902cc4d7a28 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:54.008391 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b65b1839-6388-4809-9db5-0902cc4d7a28 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:54.030788 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-b65b1839-6388-4809-9db5-0902cc4d7a28 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] HTTP exception thrown: Instance e4869087-6b2c-466b-beb3-36ad64c5d5eb could not be found. Aug 05 20:15:54.032526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b65b1839-6388-4809-9db5-0902cc4d7a28 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Request method failure captured: Aug 05 20:15:54.032526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: DELETE /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb HTTP/1.1 Aug 05 20:15:54.032526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:15:54.032526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:15:54.032526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:15:54.032526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 0 Aug 05 20:15:54.032526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:15:54.032526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:15:54.032526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:15:54.032526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:15:54.032526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XflUr6pMFYGyAct_pxI2Tj049c_XZuQFJMkzUqRUGwj-hQJDlurKTD3OVG5neYfGUOViwmRomj5cShcddXo6F9i8LvUsRkqgKBFJGesXbj1lG7l-7aUNEdkEIT7S3_oubonM6XBVeHzi6bRwAbwq_1FwCx4IhqPBtHseSu65ZuaPvs Aug 05 20:15:54.032526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:15:54.032526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:15:54.032526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:15:54.032526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:15:54.032526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 20:15:54.032526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:15:54.032526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:15:54.032526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: aa4789b47e0f47b0acd1cc4919593c33 Aug 05 20:15:54.032526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1646958349 Aug 05 20:15:54.032526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:15:54.032526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:15:54.034097 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/aa4789b47e0f47b0acd1cc4919593c33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/aa4789b47e0f47b0acd1cc4919593c33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/aa4789b47e0f47b0acd1cc4919593c33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_aa4789b47e0f47b0acd1cc4919593c33", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:15:54.034097 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1646958349 Aug 05 20:15:54.034097 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: aa4789b47e0f47b0acd1cc4919593c33 Aug 05 20:15:54.034097 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1646958349 Aug 05 20:15:54.034097 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-AttachVolumeShelveTestJSON-1646958349-project Aug 05 20:15:54.034097 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:15:54.034097 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:15:54.034097 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: 160c88a7ba0144d4b1bc953767b12bb7 Aug 05 20:15:54.034097 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1646958349-project Aug 05 20:15:54.034097 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: > Aug 05 20:15:54.034097 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Instance e4869087-6b2c-466b-beb3-36ad64c5d5eb could not be found. Aug 05 20:15:54.034097 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'id': 'e4869087-6b2c-466b-beb3-36ad64c5d5eb'} Aug 05 20:15:54.034971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:15:54.034971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:54.034971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:15:54.034971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:15:54.034971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:15:54.034971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:15:54.034971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:15:54.034971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:15:54.034971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:15:54.034971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:15:54.034971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4869087-6b2c-466b-beb3-36ad64c5d5eb could not be found. Aug 05 20:15:54.034971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:54.034971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:54.034971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:54.034971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:54.034971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:54.034971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:54.034971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:15:54.034971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:15:54.034971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:15:54.038338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:15:54.038338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:15:54.038338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:15:54.038338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:15:54.038338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:15:54.038338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:15:54.038338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:15:54.038338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:15:54.038338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:15:54.038338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4869087-6b2c-466b-beb3-36ad64c5d5eb could not be found. Aug 05 20:15:54.038338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:54.038338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:54.038338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:54.038338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:54.038338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:54.038338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:54.038338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:15:54.038338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:15:54.038338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4869087-6b2c-466b-beb3-36ad64c5d5eb could not be found. Aug 05 20:15:54.038338 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:15:54.041660 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b65b1839-6388-4809-9db5-0902cc4d7a28 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Returning 404 to user: Instance e4869087-6b2c-466b-beb3-36ad64c5d5eb could not be found. {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:15:54.041660 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b65b1839-6388-4809-9db5-0902cc4d7a28 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 404 len: 111 microversion: 2.20 time: 0.045212 Aug 05 20:15:54.041660 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 604/1188] 10.222.0.39 () {60 vars in 1280 bytes} [Fri Aug 5 20:15:53 2022] DELETE /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 20:15:54.047264 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-cec6f16a-2291-4dfd-8f5b-9e06e4b6a763 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:54.048477 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-cec6f16a-2291-4dfd-8f5b-9e06e4b6a763 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: e4869087-6b2c-466b-beb3-36ad64c5d5eb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:54.054854 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b3952189-a367-4c6b-8db5-10e7f84e6fcc tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:54.055446 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-b3952189-a367-4c6b-8db5-10e7f84e6fcc tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:54.056022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cec6f16a-2291-4dfd-8f5b-9e06e4b6a763 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:54.056960 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cec6f16a-2291-4dfd-8f5b-9e06e4b6a763 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:54.058382 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cec6f16a-2291-4dfd-8f5b-9e06e4b6a763 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:54.059547 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cec6f16a-2291-4dfd-8f5b-9e06e4b6a763 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:54.060088 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cec6f16a-2291-4dfd-8f5b-9e06e4b6a763 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:54.061049 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-cec6f16a-2291-4dfd-8f5b-9e06e4b6a763 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:54.064357 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b3952189-a367-4c6b-8db5-10e7f84e6fcc tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:54.066205 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b3952189-a367-4c6b-8db5-10e7f84e6fcc tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:54.066205 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b3952189-a367-4c6b-8db5-10e7f84e6fcc tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:54.067981 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b3952189-a367-4c6b-8db5-10e7f84e6fcc tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:54.067981 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b3952189-a367-4c6b-8db5-10e7f84e6fcc tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:54.067981 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b3952189-a367-4c6b-8db5-10e7f84e6fcc tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:54.087473 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-cec6f16a-2291-4dfd-8f5b-9e06e4b6a763 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] HTTP exception thrown: Instance e4869087-6b2c-466b-beb3-36ad64c5d5eb could not be found. Aug 05 20:15:54.090702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-cec6f16a-2291-4dfd-8f5b-9e06e4b6a763 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Request method failure captured: Aug 05 20:15:54.090702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb HTTP/1.1 Aug 05 20:15:54.090702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:15:54.090702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:15:54.090702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:15:54.090702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:15:54.090702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:15:54.090702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:15:54.090702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:15:54.090702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:15:54.090702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XflUr6pMFYGyAct_pxI2Tj049c_XZuQFJMkzUqRUGwj-hQJDlurKTD3OVG5neYfGUOViwmRomj5cShcddXo6F9i8LvUsRkqgKBFJGesXbj1lG7l-7aUNEdkEIT7S3_oubonM6XBVeHzi6bRwAbwq_1FwCx4IhqPBtHseSu65ZuaPvs Aug 05 20:15:54.090702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:15:54.090702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:15:54.090702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:15:54.090702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:15:54.090702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 20:15:54.090702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:15:54.090702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:15:54.090702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: aa4789b47e0f47b0acd1cc4919593c33 Aug 05 20:15:54.090702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1646958349 Aug 05 20:15:54.090702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:15:54.090702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:15:54.092856 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/aa4789b47e0f47b0acd1cc4919593c33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/aa4789b47e0f47b0acd1cc4919593c33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/aa4789b47e0f47b0acd1cc4919593c33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_aa4789b47e0f47b0acd1cc4919593c33", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:15:54.092856 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1646958349 Aug 05 20:15:54.092856 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: aa4789b47e0f47b0acd1cc4919593c33 Aug 05 20:15:54.092856 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1646958349 Aug 05 20:15:54.092856 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-AttachVolumeShelveTestJSON-1646958349-project Aug 05 20:15:54.092856 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:15:54.092856 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:15:54.092856 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: 160c88a7ba0144d4b1bc953767b12bb7 Aug 05 20:15:54.092856 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1646958349-project Aug 05 20:15:54.092856 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: > Aug 05 20:15:54.092856 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Instance e4869087-6b2c-466b-beb3-36ad64c5d5eb could not be found. Aug 05 20:15:54.092856 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'id': 'e4869087-6b2c-466b-beb3-36ad64c5d5eb'} Aug 05 20:15:54.093730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:15:54.093730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:54.093730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:15:54.093730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:15:54.093730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:15:54.093730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:15:54.093730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:15:54.093730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:15:54.093730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:15:54.093730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:15:54.093730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4869087-6b2c-466b-beb3-36ad64c5d5eb could not be found. Aug 05 20:15:54.093730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:54.093730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:54.093730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:54.093730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:54.093730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:54.093730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:54.093730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:15:54.093730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:15:54.093730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:15:54.095814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:15:54.095814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:15:54.095814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:15:54.095814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:15:54.095814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:15:54.095814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:15:54.095814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:15:54.095814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4869087-6b2c-466b-beb3-36ad64c5d5eb could not be found. Aug 05 20:15:54.095814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:54.095814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:54.095814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:54.095814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:54.095814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:54.095814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:54.095814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:15:54.095814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:15:54.095814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4869087-6b2c-466b-beb3-36ad64c5d5eb could not be found. Aug 05 20:15:54.095814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:54.098847 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-cec6f16a-2291-4dfd-8f5b-9e06e4b6a763 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Returning 404 to user: Instance e4869087-6b2c-466b-beb3-36ad64c5d5eb could not be found. {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:15:54.098847 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-cec6f16a-2291-4dfd-8f5b-9e06e4b6a763 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb" status: 404 len: 111 microversion: 2.20 time: 0.052367 Aug 05 20:15:54.098847 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 585/1189] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:15:54 2022] GET /compute/v2.1/servers/e4869087-6b2c-466b-beb3-36ad64c5d5eb => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 05 20:15:54.280303 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-b3952189-a367-4c6b-8db5-10e7f84e6fcc tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:54.290442 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b3952189-a367-4c6b-8db5-10e7f84e6fcc tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1677 microversion: 2.1 time: 0.239154 Aug 05 20:15:54.291551 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 605/1190] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:54 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1677 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:15:54.822871 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-b3b336d7-7e2b-4419-bb14-8048ccdb1a75 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:54.823976 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-b3b336d7-7e2b-4419-bb14-8048ccdb1a75 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:54.834868 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b3b336d7-7e2b-4419-bb14-8048ccdb1a75 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:54.835481 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b3b336d7-7e2b-4419-bb14-8048ccdb1a75 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:54.836019 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b3b336d7-7e2b-4419-bb14-8048ccdb1a75 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:54.836859 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b3b336d7-7e2b-4419-bb14-8048ccdb1a75 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:54.837670 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b3b336d7-7e2b-4419-bb14-8048ccdb1a75 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:54.839074 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b3b336d7-7e2b-4419-bb14-8048ccdb1a75 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:55.243247 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-b3b336d7-7e2b-4419-bb14-8048ccdb1a75 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:55.260502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-b3b336d7-7e2b-4419-bb14-8048ccdb1a75 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 200 len: 1266 microversion: 2.1 time: 0.454367 Aug 05 20:15:55.262100 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 586/1191] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:54 2022] GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 1266 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:55.333043 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-2d196b72-0c35-46f7-95d0-12730fd07c47 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:55.336830 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-2d196b72-0c35-46f7-95d0-12730fd07c47 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:55.339095 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-eb7be1ea-9970-4886-a769-c338b933c865 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:55.339811 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-eb7be1ea-9970-4886-a769-c338b933c865 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:55.356463 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2d196b72-0c35-46f7-95d0-12730fd07c47 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:55.358053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eb7be1ea-9970-4886-a769-c338b933c865 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:55.359935 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eb7be1ea-9970-4886-a769-c338b933c865 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:55.360411 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eb7be1ea-9970-4886-a769-c338b933c865 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:55.361420 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2d196b72-0c35-46f7-95d0-12730fd07c47 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:55.363875 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2d196b72-0c35-46f7-95d0-12730fd07c47 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:55.365832 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2d196b72-0c35-46f7-95d0-12730fd07c47 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:55.366624 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eb7be1ea-9970-4886-a769-c338b933c865 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:55.366848 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2d196b72-0c35-46f7-95d0-12730fd07c47 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:55.367564 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eb7be1ea-9970-4886-a769-c338b933c865 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:55.368078 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-eb7be1ea-9970-4886-a769-c338b933c865 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:55.368260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-2d196b72-0c35-46f7-95d0-12730fd07c47 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:55.409484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-eb7be1ea-9970-4886-a769-c338b933c865 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] HTTP exception thrown: Instance 98e6fc07-61b1-455d-8bf0-563c5debbebb could not be found. Aug 05 20:15:55.416342 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-eb7be1ea-9970-4886-a769-c338b933c865 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Request method failure captured: Aug 05 20:15:55.416342 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: DELETE /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb HTTP/1.1 Aug 05 20:15:55.416342 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:15:55.416342 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:15:55.416342 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:15:55.416342 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:15:55.416342 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:15:55.416342 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:15:55.416342 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:15:55.416342 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:15:55.416342 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XflUr6pMFYGyAct_pxI2Tj049c_XZuQFJMkzUqRUGwj-hQJDlurKTD3OVG5neYfGUOViwmRomj5cShcddXo6F9i8LvUsRkqgKBFJGesXbj1lG7l-7aUNEdkEIT7S3_oubonM6XBVeHzi6bRwAbwq_1FwCx4IhqPBtHseSu65ZuaPvs Aug 05 20:15:55.416342 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:15:55.416342 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:15:55.416342 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:15:55.416342 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:15:55.416342 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 20:15:55.416342 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:15:55.416342 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:15:55.416342 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: aa4789b47e0f47b0acd1cc4919593c33 Aug 05 20:15:55.416342 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1646958349 Aug 05 20:15:55.416342 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:15:55.416342 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:15:55.419619 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/aa4789b47e0f47b0acd1cc4919593c33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/aa4789b47e0f47b0acd1cc4919593c33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/aa4789b47e0f47b0acd1cc4919593c33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_aa4789b47e0f47b0acd1cc4919593c33", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:15:55.419619 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1646958349 Aug 05 20:15:55.419619 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: aa4789b47e0f47b0acd1cc4919593c33 Aug 05 20:15:55.419619 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1646958349 Aug 05 20:15:55.419619 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-AttachVolumeShelveTestJSON-1646958349-project Aug 05 20:15:55.419619 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:15:55.419619 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:15:55.419619 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: 160c88a7ba0144d4b1bc953767b12bb7 Aug 05 20:15:55.419619 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1646958349-project Aug 05 20:15:55.419619 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: > Aug 05 20:15:55.419619 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Instance 98e6fc07-61b1-455d-8bf0-563c5debbebb could not be found. Aug 05 20:15:55.419619 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'id': '98e6fc07-61b1-455d-8bf0-563c5debbebb'} Aug 05 20:15:55.421380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:15:55.421380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:55.421380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:15:55.421380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:15:55.421380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:15:55.421380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:15:55.421380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:15:55.421380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:15:55.421380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:15:55.421380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:15:55.421380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98e6fc07-61b1-455d-8bf0-563c5debbebb could not be found. Aug 05 20:15:55.421380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:55.421380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:55.421380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:55.421380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:55.421380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:55.421380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:55.421380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:15:55.421380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:15:55.421380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:15:55.424502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:15:55.424502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:15:55.424502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:15:55.424502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:15:55.424502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:15:55.424502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:15:55.424502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:15:55.424502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:15:55.424502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:15:55.424502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98e6fc07-61b1-455d-8bf0-563c5debbebb could not be found. Aug 05 20:15:55.424502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:55.424502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:55.424502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:55.424502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:55.424502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:55.424502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:55.424502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:15:55.424502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:15:55.424502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98e6fc07-61b1-455d-8bf0-563c5debbebb could not be found. Aug 05 20:15:55.424502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:55.430672 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-eb7be1ea-9970-4886-a769-c338b933c865 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Returning 404 to user: Instance 98e6fc07-61b1-455d-8bf0-563c5debbebb could not be found. {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:15:55.430672 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-eb7be1ea-9970-4886-a769-c338b933c865 tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "DELETE /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 404 len: 111 microversion: 2.20 time: 0.087835 Aug 05 20:15:55.430672 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 587/1192] 10.222.0.39 () {60 vars in 1280 bytes} [Fri Aug 5 20:15:55 2022] DELETE /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 20:15:55.440694 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-60cc4012-69c7-473e-9779-5a605ed59a1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:55.441999 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-60cc4012-69c7-473e-9779-5a605ed59a1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] [instance: 98e6fc07-61b1-455d-8bf0-563c5debbebb] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:55.453815 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-60cc4012-69c7-473e-9779-5a605ed59a1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:55.454918 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-60cc4012-69c7-473e-9779-5a605ed59a1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:55.456408 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-60cc4012-69c7-473e-9779-5a605ed59a1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:55.459438 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-60cc4012-69c7-473e-9779-5a605ed59a1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:55.461284 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-60cc4012-69c7-473e-9779-5a605ed59a1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:55.463908 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-60cc4012-69c7-473e-9779-5a605ed59a1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:55.496207 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-60cc4012-69c7-473e-9779-5a605ed59a1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] HTTP exception thrown: Instance 98e6fc07-61b1-455d-8bf0-563c5debbebb could not be found. Aug 05 20:15:55.497818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-60cc4012-69c7-473e-9779-5a605ed59a1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Request method failure captured: Aug 05 20:15:55.497818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb HTTP/1.1 Aug 05 20:15:55.497818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:15:55.497818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:15:55.497818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:15:55.497818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:15:55.497818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:15:55.497818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:15:55.497818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:15:55.497818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:15:55.497818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XflUr6pMFYGyAct_pxI2Tj049c_XZuQFJMkzUqRUGwj-hQJDlurKTD3OVG5neYfGUOViwmRomj5cShcddXo6F9i8LvUsRkqgKBFJGesXbj1lG7l-7aUNEdkEIT7S3_oubonM6XBVeHzi6bRwAbwq_1FwCx4IhqPBtHseSu65ZuaPvs Aug 05 20:15:55.497818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:15:55.497818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:15:55.497818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:15:55.497818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:15:55.497818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 20:15:55.497818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:15:55.497818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:15:55.497818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: aa4789b47e0f47b0acd1cc4919593c33 Aug 05 20:15:55.497818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1646958349 Aug 05 20:15:55.497818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:15:55.497818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:15:55.501210 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/aa4789b47e0f47b0acd1cc4919593c33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/aa4789b47e0f47b0acd1cc4919593c33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/aa4789b47e0f47b0acd1cc4919593c33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_aa4789b47e0f47b0acd1cc4919593c33", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:15:55.501210 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1646958349 Aug 05 20:15:55.501210 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: aa4789b47e0f47b0acd1cc4919593c33 Aug 05 20:15:55.501210 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1646958349 Aug 05 20:15:55.501210 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-AttachVolumeShelveTestJSON-1646958349-project Aug 05 20:15:55.501210 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:15:55.501210 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:15:55.501210 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: 160c88a7ba0144d4b1bc953767b12bb7 Aug 05 20:15:55.501210 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1646958349-project Aug 05 20:15:55.501210 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: > Aug 05 20:15:55.501210 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Instance 98e6fc07-61b1-455d-8bf0-563c5debbebb could not be found. Aug 05 20:15:55.501210 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'id': '98e6fc07-61b1-455d-8bf0-563c5debbebb'} Aug 05 20:15:55.503477 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:15:55.503477 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:55.503477 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:15:55.503477 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:15:55.503477 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:15:55.503477 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:15:55.503477 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:15:55.503477 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:15:55.503477 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:15:55.503477 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:15:55.503477 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98e6fc07-61b1-455d-8bf0-563c5debbebb could not be found. Aug 05 20:15:55.503477 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:55.503477 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:55.503477 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:55.503477 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:55.503477 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:55.503477 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:55.503477 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:15:55.503477 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:15:55.503477 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:15:55.508750 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:15:55.508750 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:15:55.508750 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:15:55.508750 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:15:55.508750 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:15:55.508750 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:15:55.508750 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:15:55.508750 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98e6fc07-61b1-455d-8bf0-563c5debbebb could not be found. Aug 05 20:15:55.508750 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:55.508750 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:15:55.508750 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:55.508750 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:15:55.508750 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:15:55.508750 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:15:55.508750 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:15:55.508750 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:15:55.508750 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98e6fc07-61b1-455d-8bf0-563c5debbebb could not be found. Aug 05 20:15:55.508750 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:15:55.513959 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-60cc4012-69c7-473e-9779-5a605ed59a1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] Returning 404 to user: Instance 98e6fc07-61b1-455d-8bf0-563c5debbebb could not be found. {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:15:55.513959 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-60cc4012-69c7-473e-9779-5a605ed59a1f tempest-AttachVolumeShelveTestJSON-1646958349 tempest-AttachVolumeShelveTestJSON-1646958349-project] 10.222.0.39 "GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb" status: 404 len: 111 microversion: 2.20 time: 0.068787 Aug 05 20:15:55.513959 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 588/1193] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Aug 5 20:15:55 2022] GET /compute/v2.1/servers/98e6fc07-61b1-455d-8bf0-563c5debbebb => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 20:15:55.781036 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-2d196b72-0c35-46f7-95d0-12730fd07c47 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:55.792246 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-2d196b72-0c35-46f7-95d0-12730fd07c47 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1677 microversion: 2.1 time: 0.472964 Aug 05 20:15:55.794233 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 606/1194] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:55 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1677 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:56.295489 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-1331b01f-24a1-4efc-aeaa-c49b70afe15d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:56.297547 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-1331b01f-24a1-4efc-aeaa-c49b70afe15d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:56.307671 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1331b01f-24a1-4efc-aeaa-c49b70afe15d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:56.308505 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1331b01f-24a1-4efc-aeaa-c49b70afe15d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:56.309239 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1331b01f-24a1-4efc-aeaa-c49b70afe15d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:56.310631 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1331b01f-24a1-4efc-aeaa-c49b70afe15d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:56.311402 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1331b01f-24a1-4efc-aeaa-c49b70afe15d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:56.312128 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1331b01f-24a1-4efc-aeaa-c49b70afe15d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:56.544165 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-1331b01f-24a1-4efc-aeaa-c49b70afe15d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:56.558396 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-1331b01f-24a1-4efc-aeaa-c49b70afe15d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 200 len: 1266 microversion: 2.1 time: 0.267669 Aug 05 20:15:56.573109 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 589/1195] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:56 2022] GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:56.819162 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ab1d1d27-09c6-42e1-9fc8-11ceb2dc39e6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:56.821129 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-ab1d1d27-09c6-42e1-9fc8-11ceb2dc39e6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:56.830913 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ab1d1d27-09c6-42e1-9fc8-11ceb2dc39e6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:56.832019 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ab1d1d27-09c6-42e1-9fc8-11ceb2dc39e6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:56.833041 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ab1d1d27-09c6-42e1-9fc8-11ceb2dc39e6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:56.834181 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ab1d1d27-09c6-42e1-9fc8-11ceb2dc39e6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:56.835221 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ab1d1d27-09c6-42e1-9fc8-11ceb2dc39e6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:56.836156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ab1d1d27-09c6-42e1-9fc8-11ceb2dc39e6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:56.842955 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:57.074983 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-ab1d1d27-09c6-42e1-9fc8-11ceb2dc39e6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:57.090951 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-ab1d1d27-09c6-42e1-9fc8-11ceb2dc39e6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1677 microversion: 2.1 time: 0.277354 Aug 05 20:15:57.092071 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 607/1196] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:56 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1677 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:15:57.592532 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7cf2fa86-985e-463b-840d-77b9b9fb4ccc tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:57.594818 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-7cf2fa86-985e-463b-840d-77b9b9fb4ccc tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:57.606930 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7cf2fa86-985e-463b-840d-77b9b9fb4ccc tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:57.608008 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7cf2fa86-985e-463b-840d-77b9b9fb4ccc tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:57.609907 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7cf2fa86-985e-463b-840d-77b9b9fb4ccc tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:57.611641 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7cf2fa86-985e-463b-840d-77b9b9fb4ccc tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:57.612690 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7cf2fa86-985e-463b-840d-77b9b9fb4ccc tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:57.613592 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7cf2fa86-985e-463b-840d-77b9b9fb4ccc tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:57.849503 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-7cf2fa86-985e-463b-840d-77b9b9fb4ccc tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:57.860248 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-7cf2fa86-985e-463b-840d-77b9b9fb4ccc tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 200 len: 1266 microversion: 2.1 time: 0.277249 Aug 05 20:15:57.862210 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 590/1197] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:57 2022] GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 1266 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:58.116895 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ca40e2c8-599d-4c71-8da2-824f9eff358a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:58.116895 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-ca40e2c8-599d-4c71-8da2-824f9eff358a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:58.123710 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ca40e2c8-599d-4c71-8da2-824f9eff358a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:58.124530 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ca40e2c8-599d-4c71-8da2-824f9eff358a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:58.125284 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ca40e2c8-599d-4c71-8da2-824f9eff358a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:58.126452 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ca40e2c8-599d-4c71-8da2-824f9eff358a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:58.127140 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ca40e2c8-599d-4c71-8da2-824f9eff358a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:58.127771 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ca40e2c8-599d-4c71-8da2-824f9eff358a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:58.318424 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-ca40e2c8-599d-4c71-8da2-824f9eff358a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:58.338203 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-ca40e2c8-599d-4c71-8da2-824f9eff358a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1677 microversion: 2.1 time: 0.227591 Aug 05 20:15:58.339579 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 608/1198] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:58 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1677 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:58.883678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-fd981d08-1851-40b7-b52f-6e0a8e019a03 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:58.885093 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-fd981d08-1851-40b7-b52f-6e0a8e019a03 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:58.891762 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=2 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:58.892852 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=8 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:58.896376 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fd981d08-1851-40b7-b52f-6e0a8e019a03 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:58.897093 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fd981d08-1851-40b7-b52f-6e0a8e019a03 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:58.897714 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fd981d08-1851-40b7-b52f-6e0a8e019a03 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:58.898631 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fd981d08-1851-40b7-b52f-6e0a8e019a03 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:58.899301 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fd981d08-1851-40b7-b52f-6e0a8e019a03 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:58.899899 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fd981d08-1851-40b7-b52f-6e0a8e019a03 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:59.166703 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-fd981d08-1851-40b7-b52f-6e0a8e019a03 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:59.179529 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-fd981d08-1851-40b7-b52f-6e0a8e019a03 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 200 len: 1266 microversion: 2.1 time: 0.299540 Aug 05 20:15:59.180319 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 591/1199] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:58 2022] GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 1266 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:59.381056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-beef1011-a618-4b61-8d0f-34c048a12d28 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:59.381948 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-beef1011-a618-4b61-8d0f-34c048a12d28 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:59.389913 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-beef1011-a618-4b61-8d0f-34c048a12d28 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:59.390418 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-beef1011-a618-4b61-8d0f-34c048a12d28 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:59.391590 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-beef1011-a618-4b61-8d0f-34c048a12d28 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:59.392609 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-beef1011-a618-4b61-8d0f-34c048a12d28 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:59.393265 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-beef1011-a618-4b61-8d0f-34c048a12d28 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:59.394233 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-beef1011-a618-4b61-8d0f-34c048a12d28 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:59.696658 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-beef1011-a618-4b61-8d0f-34c048a12d28 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:15:59.708369 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-beef1011-a618-4b61-8d0f-34c048a12d28 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1654 microversion: 2.1 time: 0.335370 Aug 05 20:15:59.721365 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 609/1200] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:59 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1654 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:15:59.746602 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-1a6e47ae-7aa3-4091-a471-6e61fd81bea4 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:15:59.754978 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1a6e47ae-7aa3-4091-a471-6e61fd81bea4 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:59.755405 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1a6e47ae-7aa3-4091-a471-6e61fd81bea4 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:59.755849 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1a6e47ae-7aa3-4091-a471-6e61fd81bea4 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:59.782353 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:15:59.792801 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-1a6e47ae-7aa3-4091-a471-6e61fd81bea4 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Going to try to start instance {{(pid=118191) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 05 20:15:59.874834 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-1a6e47ae-7aa3-4091-a471-6e61fd81bea4 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "POST /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0/action" status: 202 len: 0 microversion: 2.1 time: 0.133383 Aug 05 20:15:59.879983 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 592/1201] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Aug 5 20:15:59 2022] POST /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:15:59.885647 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-3bbe4b6e-9204-4a44-ac5c-08a1ed0f3a5a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:15:59.909572 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-3bbe4b6e-9204-4a44-ac5c-08a1ed0f3a5a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:15:59.933639 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3bbe4b6e-9204-4a44-ac5c-08a1ed0f3a5a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:59.935614 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3bbe4b6e-9204-4a44-ac5c-08a1ed0f3a5a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:59.936079 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3bbe4b6e-9204-4a44-ac5c-08a1ed0f3a5a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:15:59.936838 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3bbe4b6e-9204-4a44-ac5c-08a1ed0f3a5a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:15:59.937295 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3bbe4b6e-9204-4a44-ac5c-08a1ed0f3a5a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:15:59.939963 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3bbe4b6e-9204-4a44-ac5c-08a1ed0f3a5a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:00.219868 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-ed977f1d-fc73-4971-9033-d492bee99532 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:00.221225 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-ed977f1d-fc73-4971-9033-d492bee99532 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:00.232063 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ed977f1d-fc73-4971-9033-d492bee99532 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:00.232337 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ed977f1d-fc73-4971-9033-d492bee99532 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:00.233119 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ed977f1d-fc73-4971-9033-d492bee99532 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:00.234082 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ed977f1d-fc73-4971-9033-d492bee99532 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:00.235249 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ed977f1d-fc73-4971-9033-d492bee99532 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:00.235787 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-ed977f1d-fc73-4971-9033-d492bee99532 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:00.314974 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-3bbe4b6e-9204-4a44-ac5c-08a1ed0f3a5a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:16:00.329605 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-3bbe4b6e-9204-4a44-ac5c-08a1ed0f3a5a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1663 microversion: 2.1 time: 0.447069 Aug 05 20:16:00.331382 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 610/1202] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:15:59 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1663 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:16:00.543197 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-ed977f1d-fc73-4971-9033-d492bee99532 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:16:00.554503 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-ed977f1d-fc73-4971-9033-d492bee99532 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 200 len: 1266 microversion: 2.1 time: 0.345433 Aug 05 20:16:00.555726 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 593/1203] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:16:00 2022] GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 1266 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:16:01.378991 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-fb043aa2-10f1-4f1b-b51f-120e28200b3e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:01.379808 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-fb043aa2-10f1-4f1b-b51f-120e28200b3e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:01.387645 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fb043aa2-10f1-4f1b-b51f-120e28200b3e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:01.389017 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fb043aa2-10f1-4f1b-b51f-120e28200b3e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:01.391380 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fb043aa2-10f1-4f1b-b51f-120e28200b3e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:01.392553 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fb043aa2-10f1-4f1b-b51f-120e28200b3e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:01.393410 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fb043aa2-10f1-4f1b-b51f-120e28200b3e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:01.394391 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-fb043aa2-10f1-4f1b-b51f-120e28200b3e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:01.584536 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-e53ac242-3996-4d0b-a361-4788bfbf39b9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:01.586118 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-e53ac242-3996-4d0b-a361-4788bfbf39b9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:01.612361 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e53ac242-3996-4d0b-a361-4788bfbf39b9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:01.613500 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e53ac242-3996-4d0b-a361-4788bfbf39b9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:01.614774 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e53ac242-3996-4d0b-a361-4788bfbf39b9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:01.616743 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e53ac242-3996-4d0b-a361-4788bfbf39b9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:01.618743 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e53ac242-3996-4d0b-a361-4788bfbf39b9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:01.619860 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-e53ac242-3996-4d0b-a361-4788bfbf39b9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:01.630264 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-fb043aa2-10f1-4f1b-b51f-120e28200b3e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:16:01.648911 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-fb043aa2-10f1-4f1b-b51f-120e28200b3e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1663 microversion: 2.1 time: 0.283704 Aug 05 20:16:01.668078 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 611/1204] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:16:01 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1663 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:16:01.905964 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-e53ac242-3996-4d0b-a361-4788bfbf39b9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:16:01.915124 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-e53ac242-3996-4d0b-a361-4788bfbf39b9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 200 len: 1266 microversion: 2.1 time: 0.341838 Aug 05 20:16:01.915912 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 594/1205] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:16:01 2022] GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 1266 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:16:02.198128 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-85810383-7d6a-4320-bc2b-8e4c9461f127 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Action: 'create', calling method: .version_select at 0x7fe3e4805820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1337415154"}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:16:02.588317 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-85810383-7d6a-4320-bc2b-8e4c9461f127 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.566304 Aug 05 20:16:02.593874 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 612/1206] 10.222.0.39 () {60 vars in 1155 bytes} [Fri Aug 5 20:16:02 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 568 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 05 20:16:02.601980 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3d2be656-fa34-44ab-9354-f32d2ee15bf7 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Calling method '.version_select at 0x7fe3e42eeb80>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:02.655348 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3d2be656-fa34-44ab-9354-f32d2ee15bf7 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/53fb2504-1cdb-442a-a2e1-f9b992639ab6" status: 200 len: 345 microversion: 2.1 time: 0.057284 Aug 05 20:16:02.655915 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 595/1207] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Aug 5 20:16:02 2022] GET /compute/v2.1/os-volumes/53fb2504-1cdb-442a-a2e1-f9b992639ab6 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:16:02.690394 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-302e3c47-0186-4ff0-a8a8-7f8c489b72af tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:02.690907 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-302e3c47-0186-4ff0-a8a8-7f8c489b72af tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:02.697981 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-302e3c47-0186-4ff0-a8a8-7f8c489b72af tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:02.698460 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-302e3c47-0186-4ff0-a8a8-7f8c489b72af tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:02.698900 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-302e3c47-0186-4ff0-a8a8-7f8c489b72af tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:02.699597 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-302e3c47-0186-4ff0-a8a8-7f8c489b72af tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:02.700056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-302e3c47-0186-4ff0-a8a8-7f8c489b72af tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:02.700479 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-302e3c47-0186-4ff0-a8a8-7f8c489b72af tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:02.863341 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-302e3c47-0186-4ff0-a8a8-7f8c489b72af tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:16:02.873437 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-302e3c47-0186-4ff0-a8a8-7f8c489b72af tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1667 microversion: 2.1 time: 0.187240 Aug 05 20:16:02.877185 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 613/1208] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:16:02 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1667 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:16:02.938364 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-fd56cf82-a3aa-41c6-8101-1b966c17cc06 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:02.938972 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-fd56cf82-a3aa-41c6-8101-1b966c17cc06 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:02.945211 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fd56cf82-a3aa-41c6-8101-1b966c17cc06 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:02.945625 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fd56cf82-a3aa-41c6-8101-1b966c17cc06 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:02.946063 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fd56cf82-a3aa-41c6-8101-1b966c17cc06 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:02.946767 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fd56cf82-a3aa-41c6-8101-1b966c17cc06 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:02.947226 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fd56cf82-a3aa-41c6-8101-1b966c17cc06 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:02.947651 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fd56cf82-a3aa-41c6-8101-1b966c17cc06 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:03.103150 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-fd56cf82-a3aa-41c6-8101-1b966c17cc06 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:16:03.112894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-fd56cf82-a3aa-41c6-8101-1b966c17cc06 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 200 len: 1266 microversion: 2.1 time: 0.178833 Aug 05 20:16:03.113736 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 596/1209] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:16:02 2022] GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:16:03.673017 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-445ef852-42cf-4663-8b17-c13dabbc900d tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Calling method '.version_select at 0x7fe3e4661a60>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:03.752940 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-445ef852-42cf-4663-8b17-c13dabbc900d tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/53fb2504-1cdb-442a-a2e1-f9b992639ab6" status: 200 len: 346 microversion: 2.1 time: 0.086511 Aug 05 20:16:03.753608 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 614/1210] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Aug 5 20:16:03 2022] GET /compute/v2.1/os-volumes/53fb2504-1cdb-442a-a2e1-f9b992639ab6 => generated 346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:03.769751 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-2f405c99-fde5-4d5e-ac0c-ee96c37118e8 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Action: 'create', calling method: .version_select at 0x7fe3e4602d30>, body: {"snapshot": {"volume_id": "53fb2504-1cdb-442a-a2e1-f9b992639ab6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-342883370"}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:16:03.974841 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-2f405c99-fde5-4d5e-ac0c-ee96c37118e8 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] 10.222.0.39 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.211176 Aug 05 20:16:03.975868 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 597/1211] 10.222.0.39 () {60 vars in 1162 bytes} [Fri Aug 5 20:16:03 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:03.993843 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-e57c8c6a-218b-4ef6-a9a3-c706c5603e9a tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Calling method '.version_select at 0x7fe3e470a160>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:04.034765 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-e57c8c6a-218b-4ef6-a9a3-c706c5603e9a tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/542435e0-611f-4af6-9a7c-6f35b7bdfce5" status: 200 len: 286 microversion: 2.1 time: 0.047307 Aug 05 20:16:04.035336 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 615/1212] 10.222.0.39 () {58 vars in 1251 bytes} [Fri Aug 5 20:16:03 2022] GET /compute/v2.1/os-snapshots/542435e0-611f-4af6-9a7c-6f35b7bdfce5 => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:16:04.046574 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-27081a76-3367-48db-a9f5-3a6a31320b28 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Calling method '.version_select at 0x7fe3e42ee280>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:04.084658 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-27081a76-3367-48db-a9f5-3a6a31320b28 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.041733 Aug 05 20:16:04.085231 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 598/1213] 10.222.0.39 () {58 vars in 1140 bytes} [Fri Aug 5 20:16:04 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:04.100816 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-0ea3ef03-c750-4740-8bee-ac7f3057a99e tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Calling method '.version_select at 0x7fe3e4805820>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:04.134719 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-67968919-908a-4528-8ca6-36233f3ad3cf tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:04.135355 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-67968919-908a-4528-8ca6-36233f3ad3cf tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:04.136323 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-0ea3ef03-c750-4740-8bee-ac7f3057a99e tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/542435e0-611f-4af6-9a7c-6f35b7bdfce5" status: 200 len: 286 microversion: 2.1 time: 0.040911 Aug 05 20:16:04.136932 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 616/1214] 10.222.0.39 () {58 vars in 1251 bytes} [Fri Aug 5 20:16:04 2022] GET /compute/v2.1/os-snapshots/542435e0-611f-4af6-9a7c-6f35b7bdfce5 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:04.143448 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-67968919-908a-4528-8ca6-36233f3ad3cf tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:04.144890 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-67968919-908a-4528-8ca6-36233f3ad3cf tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:04.145563 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-67968919-908a-4528-8ca6-36233f3ad3cf tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:04.146601 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-67968919-908a-4528-8ca6-36233f3ad3cf tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:04.147376 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-67968919-908a-4528-8ca6-36233f3ad3cf tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:04.147937 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-67968919-908a-4528-8ca6-36233f3ad3cf tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:04.320501 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-67968919-908a-4528-8ca6-36233f3ad3cf tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:16:04.330654 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-67968919-908a-4528-8ca6-36233f3ad3cf tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 200 len: 1266 microversion: 2.1 time: 0.200242 Aug 05 20:16:04.331225 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 599/1215] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:16:04 2022] GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:16:05.157912 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b6bd5255-5a65-49b3-b8bc-363949af0428 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Calling method '.version_select at 0x7fe3e4661a60>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:05.202414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b6bd5255-5a65-49b3-b8bc-363949af0428 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/542435e0-611f-4af6-9a7c-6f35b7bdfce5" status: 200 len: 286 microversion: 2.1 time: 0.053629 Aug 05 20:16:05.203589 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 617/1216] 10.222.0.39 () {58 vars in 1251 bytes} [Fri Aug 5 20:16:05 2022] GET /compute/v2.1/os-snapshots/542435e0-611f-4af6-9a7c-6f35b7bdfce5 => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:05.357132 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-0dad146a-8183-4a1a-b622-91bf901ea677 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:05.358172 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-0dad146a-8183-4a1a-b622-91bf901ea677 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:05.381463 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0dad146a-8183-4a1a-b622-91bf901ea677 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:05.382880 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0dad146a-8183-4a1a-b622-91bf901ea677 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:05.384088 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0dad146a-8183-4a1a-b622-91bf901ea677 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:05.385555 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0dad146a-8183-4a1a-b622-91bf901ea677 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:05.386744 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0dad146a-8183-4a1a-b622-91bf901ea677 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:05.387515 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0dad146a-8183-4a1a-b622-91bf901ea677 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:05.548042 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-0dad146a-8183-4a1a-b622-91bf901ea677 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:16:05.556618 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-0dad146a-8183-4a1a-b622-91bf901ea677 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 200 len: 1266 microversion: 2.1 time: 0.207896 Aug 05 20:16:05.557234 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 600/1217] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:16:05 2022] GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:16:06.219171 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-12bee1fe-b767-42c6-988a-9367565786ab tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Calling method '.version_select at 0x7fe3e48051f0>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:06.249848 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-12bee1fe-b767-42c6-988a-9367565786ab tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/542435e0-611f-4af6-9a7c-6f35b7bdfce5" status: 200 len: 286 microversion: 2.1 time: 0.035333 Aug 05 20:16:06.251071 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 618/1218] 10.222.0.39 () {58 vars in 1251 bytes} [Fri Aug 5 20:16:06 2022] GET /compute/v2.1/os-snapshots/542435e0-611f-4af6-9a7c-6f35b7bdfce5 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:06.580110 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-77041a52-d2e5-420d-9f84-56894c847d7a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:06.580510 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-77041a52-d2e5-420d-9f84-56894c847d7a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:06.586938 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-77041a52-d2e5-420d-9f84-56894c847d7a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:06.587424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-77041a52-d2e5-420d-9f84-56894c847d7a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:06.587851 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-77041a52-d2e5-420d-9f84-56894c847d7a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:06.588542 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-77041a52-d2e5-420d-9f84-56894c847d7a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:06.589013 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-77041a52-d2e5-420d-9f84-56894c847d7a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:06.589434 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-77041a52-d2e5-420d-9f84-56894c847d7a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:06.754945 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-77041a52-d2e5-420d-9f84-56894c847d7a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:16:06.764856 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-77041a52-d2e5-420d-9f84-56894c847d7a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 200 len: 1266 microversion: 2.1 time: 0.189186 Aug 05 20:16:06.766258 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 601/1219] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:16:06 2022] GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:16:07.264174 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-192374cb-0025-4c80-b8b0-9677a567eab9 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Calling method '.version_select at 0x7fe3e4655550>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:07.299937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-192374cb-0025-4c80-b8b0-9677a567eab9 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/542435e0-611f-4af6-9a7c-6f35b7bdfce5" status: 200 len: 286 microversion: 2.1 time: 0.040304 Aug 05 20:16:07.300534 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 619/1220] 10.222.0.39 () {58 vars in 1251 bytes} [Fri Aug 5 20:16:07 2022] GET /compute/v2.1/os-snapshots/542435e0-611f-4af6-9a7c-6f35b7bdfce5 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:07.792197 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-222bf13d-badb-4346-a0f9-72d19ed49f0c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:07.793078 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-222bf13d-badb-4346-a0f9-72d19ed49f0c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:07.800722 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-222bf13d-badb-4346-a0f9-72d19ed49f0c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:07.801213 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-222bf13d-badb-4346-a0f9-72d19ed49f0c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:07.801651 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-222bf13d-badb-4346-a0f9-72d19ed49f0c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:07.802362 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-222bf13d-badb-4346-a0f9-72d19ed49f0c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:07.802812 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-222bf13d-badb-4346-a0f9-72d19ed49f0c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:07.803238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-222bf13d-badb-4346-a0f9-72d19ed49f0c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:07.947011 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-222bf13d-badb-4346-a0f9-72d19ed49f0c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:16:07.957629 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-222bf13d-badb-4346-a0f9-72d19ed49f0c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 200 len: 1266 microversion: 2.1 time: 0.171644 Aug 05 20:16:07.958189 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 602/1221] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:16:07 2022] GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:16:08.316019 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-9d114ef2-26a3-400b-9f08-849703713ff9 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Calling method '.version_select at 0x7fe3e6a47ee0>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:08.347033 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-9d114ef2-26a3-400b-9f08-849703713ff9 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/542435e0-611f-4af6-9a7c-6f35b7bdfce5" status: 200 len: 286 microversion: 2.1 time: 0.036993 Aug 05 20:16:08.347605 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 620/1222] 10.222.0.39 () {58 vars in 1251 bytes} [Fri Aug 5 20:16:08 2022] GET /compute/v2.1/os-snapshots/542435e0-611f-4af6-9a7c-6f35b7bdfce5 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:16:08.785414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:16:08.785688 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Fri Aug 5 20:16:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:16:08.980613 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-2ad00a73-1d69-4e71-9613-96c1304182a9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:08.981234 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-2ad00a73-1d69-4e71-9613-96c1304182a9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:08.988845 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2ad00a73-1d69-4e71-9613-96c1304182a9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:08.989367 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2ad00a73-1d69-4e71-9613-96c1304182a9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:08.989824 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2ad00a73-1d69-4e71-9613-96c1304182a9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:08.990547 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2ad00a73-1d69-4e71-9613-96c1304182a9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:08.991007 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2ad00a73-1d69-4e71-9613-96c1304182a9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:08.991438 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-2ad00a73-1d69-4e71-9613-96c1304182a9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:09.141635 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-2ad00a73-1d69-4e71-9613-96c1304182a9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:16:09.150202 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-2ad00a73-1d69-4e71-9613-96c1304182a9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 200 len: 1266 microversion: 2.1 time: 0.173414 Aug 05 20:16:09.150759 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 603/1223] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:16:08 2022] GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:16:09.361955 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-0ae25df4-903f-4e83-9c7d-6a7dad1f685e tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Calling method '.version_select at 0x7fe3e48cc940>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:09.407126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-0ae25df4-903f-4e83-9c7d-6a7dad1f685e tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/542435e0-611f-4af6-9a7c-6f35b7bdfce5" status: 200 len: 287 microversion: 2.1 time: 0.049716 Aug 05 20:16:09.408222 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 621/1224] 10.222.0.39 () {58 vars in 1251 bytes} [Fri Aug 5 20:16:09 2022] GET /compute/v2.1/os-snapshots/542435e0-611f-4af6-9a7c-6f35b7bdfce5 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:16:09.420553 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3eea7902-2ff6-4d0c-ad6b-d3acdc8b7523 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Calling method '.version_select at 0x7fe3e8e40310>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:09.483971 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3eea7902-2ff6-4d0c-ad6b-d3acdc8b7523 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] 10.222.0.39 "DELETE /compute/v2.1/os-snapshots/542435e0-611f-4af6-9a7c-6f35b7bdfce5" status: 202 len: 0 microversion: 2.1 time: 0.067637 Aug 05 20:16:09.484970 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 604/1225] 10.222.0.39 () {58 vars in 1254 bytes} [Fri Aug 5 20:16:09 2022] DELETE /compute/v2.1/os-snapshots/542435e0-611f-4af6-9a7c-6f35b7bdfce5 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:16:09.494954 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-94a2278e-9468-48a1-b6ef-f9f478fefc95 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Calling method '.version_select at 0x7fe3e4661af0>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:09.532243 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-94a2278e-9468-48a1-b6ef-f9f478fefc95 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/542435e0-611f-4af6-9a7c-6f35b7bdfce5" status: 200 len: 286 microversion: 2.1 time: 0.041479 Aug 05 20:16:09.532849 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 622/1226] 10.222.0.39 () {58 vars in 1251 bytes} [Fri Aug 5 20:16:09 2022] GET /compute/v2.1/os-snapshots/542435e0-611f-4af6-9a7c-6f35b7bdfce5 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:16:10.172022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-b0bfa1b9-8b68-44b7-96bd-b9cd997acf5e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:10.172665 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-b0bfa1b9-8b68-44b7-96bd-b9cd997acf5e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:10.178807 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b0bfa1b9-8b68-44b7-96bd-b9cd997acf5e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:10.179298 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b0bfa1b9-8b68-44b7-96bd-b9cd997acf5e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:10.179729 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b0bfa1b9-8b68-44b7-96bd-b9cd997acf5e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:10.180440 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b0bfa1b9-8b68-44b7-96bd-b9cd997acf5e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:10.180930 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b0bfa1b9-8b68-44b7-96bd-b9cd997acf5e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:10.181354 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b0bfa1b9-8b68-44b7-96bd-b9cd997acf5e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:10.331005 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-b0bfa1b9-8b68-44b7-96bd-b9cd997acf5e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:16:10.338833 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-b0bfa1b9-8b68-44b7-96bd-b9cd997acf5e tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 200 len: 1266 microversion: 2.1 time: 0.171112 Aug 05 20:16:10.339426 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 605/1227] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:16:10 2022] GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:16:10.547489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-bfc01190-ff15-4f5a-a6fd-eb35055fbb81 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Calling method '.version_select at 0x7fe3e6d97f70>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:10.578374 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-f1db35d4-f778-411c-99b1-49164ad0cd18 req-5fc41d96-bab1-4c91-9b80-4bbb5ab0fb53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f346a0be-3cbc-4049-b079-576f8c9196be", "name": "network-vif-plugged", "status": "completed", "tag": "dd271ba4-7623-4f70-8dfb-7497cc0f0c3d"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:16:10.588274 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-f1db35d4-f778-411c-99b1-49164ad0cd18 req-5fc41d96-bab1-4c91-9b80-4bbb5ab0fb53 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:10.588797 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-f1db35d4-f778-411c-99b1-49164ad0cd18 req-5fc41d96-bab1-4c91-9b80-4bbb5ab0fb53 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:10.589239 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-f1db35d4-f778-411c-99b1-49164ad0cd18 req-5fc41d96-bab1-4c91-9b80-4bbb5ab0fb53 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:10.599021 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-bfc01190-ff15-4f5a-a6fd-eb35055fbb81 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] HTTP exception thrown: Snapshot 542435e0-611f-4af6-9a7c-6f35b7bdfce5 could not be found. Aug 05 20:16:10.602933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-bfc01190-ff15-4f5a-a6fd-eb35055fbb81 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Request method failure captured: Aug 05 20:16:10.602933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: GET /compute/v2.1/os-snapshots/542435e0-611f-4af6-9a7c-6f35b7bdfce5 HTTP/1.1 Aug 05 20:16:10.602933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:16:10.602933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:16:10.602933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:16:10.602933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 0 Aug 05 20:16:10.602933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:16:10.602933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:16:10.602933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:16:10.602933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:16:10.602933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XqB-M4S7jmlKOLL44bwN-oILe-Yu_TIj6XvTvIKCDCWpHh5F1hZKpcteU3ZkM5VA--BEezq_cFDQ3FlvhCV2WGHPaRlf9Vd_Afl0FXYZo57zXCcKujOWQYnQE6I8YNzylsF3qIMPDG1C_cHzgrEoaxIYgP5dtSubVopF4EghyicUnQ Aug 05 20:16:10.602933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:16:10.602933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:16:10.602933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:16:10.602933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:16:10.602933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:16:10.602933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:16:10.602933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: 03344da5c61d404a9361b4f9aeed1cd4 Aug 05 20:16:10.602933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-325515921 Aug 05 20:16:10.602933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:16:10.602933 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:16:10.605950 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/03344da5c61d404a9361b4f9aeed1cd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/03344da5c61d404a9361b4f9aeed1cd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/03344da5c61d404a9361b4f9aeed1cd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_03344da5c61d404a9361b4f9aeed1cd4", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:16:10.605950 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-VolumesSnapshotsTestJSON-325515921 Aug 05 20:16:10.605950 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: 03344da5c61d404a9361b4f9aeed1cd4 Aug 05 20:16:10.605950 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-325515921 Aug 05 20:16:10.605950 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-VolumesSnapshotsTestJSON-325515921-project Aug 05 20:16:10.605950 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:16:10.605950 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:16:10.605950 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: 980873d89ec84c8284eb5e78a42b072f Aug 05 20:16:10.605950 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-VolumesSnapshotsTestJSON-325515921-project Aug 05 20:16:10.605950 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: Aug 05 20:16:10.605950 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Snapshot 542435e0-611f-4af6-9a7c-6f35b7bdfce5 could not be found. Aug 05 20:16:10.605950 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'id': '542435e0-611f-4af6-9a7c-6f35b7bdfce5'} Aug 05 20:16:10.605950 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:16:10.609073 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:10.609073 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 05 20:16:10.609073 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 05 20:16:10.609073 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 05 20:16:10.609073 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 05 20:16:10.609073 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 05 20:16:10.609073 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 05 20:16:10.609073 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:16:10.609073 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:16:10.609073 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:16:10.609073 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:16:10.609073 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:16:10.609073 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:16:10.609073 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:16:10.609073 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:16:10.609073 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 542435e0-611f-4af6-9a7c-6f35b7bdfce5 could not be found. (HTTP 404) (Request-ID: req-675fbae2-ead2-49e2-8777-41c496f5de30) Aug 05 20:16:10.609073 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:16:10.609073 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:10.615009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:16:10.615009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:10.615009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 05 20:16:10.615009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 05 20:16:10.615009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 20:16:10.615009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 20:16:10.615009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 05 20:16:10.615009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 05 20:16:10.615009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 20:16:10.615009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 20:16:10.615009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 05 20:16:10.615009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 05 20:16:10.615009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 05 20:16:10.615009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 05 20:16:10.615009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 05 20:16:10.615009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 05 20:16:10.615009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:16:10.615009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:16:10.615009 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:16:10.617056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:16:10.617056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:16:10.617056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:16:10.617056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:16:10.617056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:16:10.617056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 542435e0-611f-4af6-9a7c-6f35b7bdfce5 could not be found. Aug 05 20:16:10.617056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:16:10.617056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:10.617056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:16:10.617056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:10.617056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:10.617056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:10.617056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:16:10.617056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:16:10.617056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:16:10.617056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:16:10.617056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:16:10.617056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:16:10.617056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 05 20:16:10.617056 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:16:10.620410 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 542435e0-611f-4af6-9a7c-6f35b7bdfce5 could not be found. Aug 05 20:16:10.620410 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:16:10.620410 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:10.620410 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:16:10.620410 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:10.620410 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:10.620410 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:10.620410 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:16:10.620410 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:16:10.620410 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 542435e0-611f-4af6-9a7c-6f35b7bdfce5 could not be found. Aug 05 20:16:10.620410 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:16:10.620410 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-bfc01190-ff15-4f5a-a6fd-eb35055fbb81 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Returning 404 to user: Snapshot 542435e0-611f-4af6-9a7c-6f35b7bdfce5 could not be found. {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:16:10.620410 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-bfc01190-ff15-4f5a-a6fd-eb35055fbb81 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/542435e0-611f-4af6-9a7c-6f35b7bdfce5" status: 404 len: 111 microversion: 2.1 time: 0.063670 Aug 05 20:16:10.622652 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-f1db35d4-f778-411c-99b1-49164ad0cd18 req-5fc41d96-bab1-4c91-9b80-4bbb5ab0fb53 service nova] Creating event network-vif-plugged:dd271ba4-7623-4f70-8dfb-7497cc0f0c3d for instance f346a0be-3cbc-4049-b079-576f8c9196be on hv-cinder-85221 Aug 05 20:16:10.622826 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 623/1228] 10.222.0.39 () {58 vars in 1251 bytes} [Fri Aug 5 20:16:10 2022] GET /compute/v2.1/os-snapshots/542435e0-611f-4af6-9a7c-6f35b7bdfce5 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:16:10.623000 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-f1db35d4-f778-411c-99b1-49164ad0cd18 req-5fc41d96-bab1-4c91-9b80-4bbb5ab0fb53 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038686 Aug 05 20:16:10.623000 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 606/1229] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:16:10.623301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-1d59920d-7d26-4756-9c56-c6dc842d04e5 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Calling method '.version_select at 0x7fe3e6d97f70>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:10.704448 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-1d59920d-7d26-4756-9c56-c6dc842d04e5 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/53fb2504-1cdb-442a-a2e1-f9b992639ab6" status: 202 len: 0 microversion: 2.1 time: 0.091556 Aug 05 20:16:10.705348 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 624/1230] 10.222.0.39 () {58 vars in 1248 bytes} [Fri Aug 5 20:16:10 2022] DELETE /compute/v2.1/os-volumes/53fb2504-1cdb-442a-a2e1-f9b992639ab6 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:16:10.723775 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-6afbff48-bffd-42f5-a67e-6edf0fa21a82 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Calling method '.version_select at 0x7fe3e8e40c10>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:10.789258 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-6afbff48-bffd-42f5-a67e-6edf0fa21a82 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/53fb2504-1cdb-442a-a2e1-f9b992639ab6" status: 200 len: 345 microversion: 2.1 time: 0.078048 Aug 05 20:16:10.789977 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 607/1231] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Aug 5 20:16:10 2022] GET /compute/v2.1/os-volumes/53fb2504-1cdb-442a-a2e1-f9b992639ab6 => generated 345 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:16:11.361483 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-d5baea6b-dd54-4fda-b991-e2009b83d0f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:11.362095 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-d5baea6b-dd54-4fda-b991-e2009b83d0f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:11.364057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:16:11.369586 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d5baea6b-dd54-4fda-b991-e2009b83d0f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:11.370105 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d5baea6b-dd54-4fda-b991-e2009b83d0f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:11.370519 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d5baea6b-dd54-4fda-b991-e2009b83d0f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:11.371216 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d5baea6b-dd54-4fda-b991-e2009b83d0f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:11.371663 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d5baea6b-dd54-4fda-b991-e2009b83d0f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:11.372083 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d5baea6b-dd54-4fda-b991-e2009b83d0f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:11.555724 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-d5baea6b-dd54-4fda-b991-e2009b83d0f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:16:11.569796 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-d5baea6b-dd54-4fda-b991-e2009b83d0f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 200 len: 1266 microversion: 2.1 time: 0.212934 Aug 05 20:16:11.570803 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 625/1232] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:16:11 2022] GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:16:11.806878 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-efffa77a-8a27-4341-9946-1c2f7147914f tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Calling method '.version_select at 0x7fe3e4e1fa60>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:11.838483 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-efffa77a-8a27-4341-9946-1c2f7147914f tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] HTTP exception thrown: Volume 53fb2504-1cdb-442a-a2e1-f9b992639ab6 could not be found. Aug 05 20:16:11.840517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-efffa77a-8a27-4341-9946-1c2f7147914f tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Request method failure captured: Aug 05 20:16:11.840517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: GET /compute/v2.1/os-volumes/53fb2504-1cdb-442a-a2e1-f9b992639ab6 HTTP/1.1 Aug 05 20:16:11.840517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:16:11.840517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:16:11.840517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:16:11.840517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:16:11.840517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:16:11.840517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:16:11.840517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:16:11.840517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:16:11.840517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XqB-M4S7jmlKOLL44bwN-oILe-Yu_TIj6XvTvIKCDCWpHh5F1hZKpcteU3ZkM5VA--BEezq_cFDQ3FlvhCV2WGHPaRlf9Vd_Afl0FXYZo57zXCcKujOWQYnQE6I8YNzylsF3qIMPDG1C_cHzgrEoaxIYgP5dtSubVopF4EghyicUnQ Aug 05 20:16:11.840517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:16:11.840517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:16:11.840517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:16:11.840517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:16:11.840517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:16:11.840517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:16:11.840517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: 03344da5c61d404a9361b4f9aeed1cd4 Aug 05 20:16:11.840517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-325515921 Aug 05 20:16:11.840517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:16:11.840517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:16:11.843039 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/03344da5c61d404a9361b4f9aeed1cd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/03344da5c61d404a9361b4f9aeed1cd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/03344da5c61d404a9361b4f9aeed1cd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_03344da5c61d404a9361b4f9aeed1cd4", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:16:11.843039 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-VolumesSnapshotsTestJSON-325515921 Aug 05 20:16:11.843039 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: 03344da5c61d404a9361b4f9aeed1cd4 Aug 05 20:16:11.843039 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-325515921 Aug 05 20:16:11.843039 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-VolumesSnapshotsTestJSON-325515921-project Aug 05 20:16:11.843039 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:16:11.843039 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:16:11.843039 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: 980873d89ec84c8284eb5e78a42b072f Aug 05 20:16:11.843039 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-VolumesSnapshotsTestJSON-325515921-project Aug 05 20:16:11.843039 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: Aug 05 20:16:11.843039 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Volume 53fb2504-1cdb-442a-a2e1-f9b992639ab6 could not be found. Aug 05 20:16:11.843039 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'id': '53fb2504-1cdb-442a-a2e1-f9b992639ab6'} Aug 05 20:16:11.843039 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:16:11.844424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:11.844424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:16:11.844424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:16:11.844424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 20:16:11.844424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 20:16:11.844424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 20:16:11.844424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 20:16:11.844424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:16:11.844424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:16:11.844424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:16:11.844424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:16:11.844424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:16:11.844424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:16:11.844424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:16:11.844424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:16:11.844424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 53fb2504-1cdb-442a-a2e1-f9b992639ab6 could not be found. (HTTP 404) (Request-ID: req-921aba43-754d-4703-92da-c31884b6aad5) Aug 05 20:16:11.844424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:16:11.844424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:11.844424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:16:11.846445 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:11.846445 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 20:16:11.846445 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 20:16:11.846445 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 20:16:11.846445 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 20:16:11.846445 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 20:16:11.846445 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 20:16:11.846445 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 20:16:11.846445 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 20:16:11.846445 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:16:11.846445 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:16:11.846445 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 20:16:11.846445 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 20:16:11.846445 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 20:16:11.846445 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 20:16:11.846445 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:16:11.846445 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:16:11.846445 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:16:11.846445 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:16:11.848051 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:16:11.848051 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:16:11.848051 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:16:11.848051 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:16:11.848051 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 53fb2504-1cdb-442a-a2e1-f9b992639ab6 could not be found. Aug 05 20:16:11.848051 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:16:11.848051 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:11.848051 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:16:11.848051 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:11.848051 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:11.848051 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:11.848051 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:16:11.848051 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:16:11.848051 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:16:11.848051 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:16:11.848051 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:16:11.848051 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:16:11.848051 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 20:16:11.848051 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:16:11.849601 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 53fb2504-1cdb-442a-a2e1-f9b992639ab6 could not be found. Aug 05 20:16:11.849601 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:16:11.849601 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:11.849601 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:16:11.849601 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:11.849601 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:11.849601 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:11.849601 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:16:11.849601 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:16:11.849601 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 53fb2504-1cdb-442a-a2e1-f9b992639ab6 could not be found. Aug 05 20:16:11.849601 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:16:11.849601 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-efffa77a-8a27-4341-9946-1c2f7147914f tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Returning 404 to user: Volume 53fb2504-1cdb-442a-a2e1-f9b992639ab6 could not be found. {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:16:11.849601 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-efffa77a-8a27-4341-9946-1c2f7147914f tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/53fb2504-1cdb-442a-a2e1-f9b992639ab6" status: 404 len: 109 microversion: 2.1 time: 0.041224 Aug 05 20:16:11.849601 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 608/1233] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Aug 5 20:16:11 2022] GET /compute/v2.1/os-volumes/53fb2504-1cdb-442a-a2e1-f9b992639ab6 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:16:11.856636 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-3c71a695-1348-44e3-ab79-c14f2caf7069 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Calling method '.version_select at 0x7fe3e46badc0>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:11.894593 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-3c71a695-1348-44e3-ab79-c14f2caf7069 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] HTTP exception thrown: Volume 53fb2504-1cdb-442a-a2e1-f9b992639ab6 could not be found. Aug 05 20:16:11.896540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-3c71a695-1348-44e3-ab79-c14f2caf7069 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Request method failure captured: Aug 05 20:16:11.896540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: DELETE /compute/v2.1/os-volumes/53fb2504-1cdb-442a-a2e1-f9b992639ab6 HTTP/1.1 Aug 05 20:16:11.896540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:16:11.896540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:16:11.896540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:16:11.896540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 0 Aug 05 20:16:11.896540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:16:11.896540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:16:11.896540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:16:11.896540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:16:11.896540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XqB-M4S7jmlKOLL44bwN-oILe-Yu_TIj6XvTvIKCDCWpHh5F1hZKpcteU3ZkM5VA--BEezq_cFDQ3FlvhCV2WGHPaRlf9Vd_Afl0FXYZo57zXCcKujOWQYnQE6I8YNzylsF3qIMPDG1C_cHzgrEoaxIYgP5dtSubVopF4EghyicUnQ Aug 05 20:16:11.896540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:16:11.896540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:16:11.896540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:16:11.896540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:16:11.896540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:16:11.896540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:16:11.896540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: 03344da5c61d404a9361b4f9aeed1cd4 Aug 05 20:16:11.896540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-325515921 Aug 05 20:16:11.896540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:16:11.896540 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:16:11.899354 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/03344da5c61d404a9361b4f9aeed1cd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/03344da5c61d404a9361b4f9aeed1cd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/03344da5c61d404a9361b4f9aeed1cd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_03344da5c61d404a9361b4f9aeed1cd4", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:16:11.899354 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-VolumesSnapshotsTestJSON-325515921 Aug 05 20:16:11.899354 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: 03344da5c61d404a9361b4f9aeed1cd4 Aug 05 20:16:11.899354 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-325515921 Aug 05 20:16:11.899354 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-VolumesSnapshotsTestJSON-325515921-project Aug 05 20:16:11.899354 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:16:11.899354 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:16:11.899354 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: 980873d89ec84c8284eb5e78a42b072f Aug 05 20:16:11.899354 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-VolumesSnapshotsTestJSON-325515921-project Aug 05 20:16:11.899354 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: Aug 05 20:16:11.899354 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Volume 53fb2504-1cdb-442a-a2e1-f9b992639ab6 could not be found. Aug 05 20:16:11.899354 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'id': '53fb2504-1cdb-442a-a2e1-f9b992639ab6'} Aug 05 20:16:11.899354 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:16:11.900414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:11.900414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:16:11.900414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:16:11.900414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 20:16:11.900414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 20:16:11.900414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 20:16:11.900414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 20:16:11.900414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 20:16:11.900414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 20:16:11.900414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 20:16:11.900414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 20:16:11.900414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:16:11.900414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:16:11.900414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:16:11.900414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:16:11.900414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 53fb2504-1cdb-442a-a2e1-f9b992639ab6 could not be found. (HTTP 404) (Request-ID: req-965803bc-2ff6-41f6-8604-0982adfc2da7) Aug 05 20:16:11.900414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:16:11.900414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:11.900414 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:16:11.902802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:11.902802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 20:16:11.902802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 20:16:11.902802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 20:16:11.902802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 20:16:11.902802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 20:16:11.902802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 20:16:11.902802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 20:16:11.902802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 20:16:11.902802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:16:11.902802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:16:11.902802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 20:16:11.902802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 20:16:11.902802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 20:16:11.902802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 20:16:11.902802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 20:16:11.902802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 20:16:11.902802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 20:16:11.902802 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 20:16:11.905798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:16:11.905798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:16:11.905798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:16:11.905798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:16:11.905798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 53fb2504-1cdb-442a-a2e1-f9b992639ab6 could not be found. Aug 05 20:16:11.905798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:16:11.905798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:11.905798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:16:11.905798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:11.905798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:11.905798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:11.905798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:16:11.905798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:16:11.905798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:16:11.905798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:16:11.905798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:16:11.905798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:16:11.905798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 20:16:11.905798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:16:11.908866 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 53fb2504-1cdb-442a-a2e1-f9b992639ab6 could not be found. Aug 05 20:16:11.908866 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:16:11.908866 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:11.908866 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:16:11.908866 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:11.908866 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:11.908866 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:11.908866 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:16:11.908866 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:16:11.908866 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 53fb2504-1cdb-442a-a2e1-f9b992639ab6 could not be found. Aug 05 20:16:11.908866 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:16:11.908866 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-3c71a695-1348-44e3-ab79-c14f2caf7069 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Returning 404 to user: Volume 53fb2504-1cdb-442a-a2e1-f9b992639ab6 could not be found. {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:16:11.908866 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-3c71a695-1348-44e3-ab79-c14f2caf7069 tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/53fb2504-1cdb-442a-a2e1-f9b992639ab6" status: 404 len: 109 microversion: 2.1 time: 0.045329 Aug 05 20:16:11.908866 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 626/1234] 10.222.0.39 () {58 vars in 1248 bytes} [Fri Aug 5 20:16:11 2022] DELETE /compute/v2.1/os-volumes/53fb2504-1cdb-442a-a2e1-f9b992639ab6 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:16:11.911290 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-88d86c11-0382-469b-b66c-16a2e7f79ada tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Calling method '.version_select at 0x7fe3e5007f70>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:11.943493 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-88d86c11-0382-469b-b66c-16a2e7f79ada tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] HTTP exception thrown: Volume 53fb2504-1cdb-442a-a2e1-f9b992639ab6 could not be found. Aug 05 20:16:11.945716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-88d86c11-0382-469b-b66c-16a2e7f79ada tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Request method failure captured: Aug 05 20:16:11.945716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: GET /compute/v2.1/os-volumes/53fb2504-1cdb-442a-a2e1-f9b992639ab6 HTTP/1.1 Aug 05 20:16:11.945716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:16:11.945716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:16:11.945716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:16:11.945716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:16:11.945716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:16:11.945716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:16:11.945716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:16:11.945716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:16:11.945716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XqB-M4S7jmlKOLL44bwN-oILe-Yu_TIj6XvTvIKCDCWpHh5F1hZKpcteU3ZkM5VA--BEezq_cFDQ3FlvhCV2WGHPaRlf9Vd_Afl0FXYZo57zXCcKujOWQYnQE6I8YNzylsF3qIMPDG1C_cHzgrEoaxIYgP5dtSubVopF4EghyicUnQ Aug 05 20:16:11.945716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:16:11.945716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:16:11.945716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:16:11.945716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:16:11.945716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:16:11.945716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:16:11.945716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: 03344da5c61d404a9361b4f9aeed1cd4 Aug 05 20:16:11.945716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-325515921 Aug 05 20:16:11.945716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:16:11.945716 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:16:11.947549 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/03344da5c61d404a9361b4f9aeed1cd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/03344da5c61d404a9361b4f9aeed1cd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/03344da5c61d404a9361b4f9aeed1cd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_03344da5c61d404a9361b4f9aeed1cd4", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:16:11.947549 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-VolumesSnapshotsTestJSON-325515921 Aug 05 20:16:11.947549 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: 03344da5c61d404a9361b4f9aeed1cd4 Aug 05 20:16:11.947549 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-325515921 Aug 05 20:16:11.947549 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-VolumesSnapshotsTestJSON-325515921-project Aug 05 20:16:11.947549 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:16:11.947549 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:16:11.947549 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: 980873d89ec84c8284eb5e78a42b072f Aug 05 20:16:11.947549 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-VolumesSnapshotsTestJSON-325515921-project Aug 05 20:16:11.947549 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: Aug 05 20:16:11.947549 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Volume 53fb2504-1cdb-442a-a2e1-f9b992639ab6 could not be found. Aug 05 20:16:11.947549 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'id': '53fb2504-1cdb-442a-a2e1-f9b992639ab6'} Aug 05 20:16:11.947549 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:16:11.948533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:11.948533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:16:11.948533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:16:11.948533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 20:16:11.948533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 20:16:11.948533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 20:16:11.948533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 20:16:11.948533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:16:11.948533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:16:11.948533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:16:11.948533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:16:11.948533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:16:11.948533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:16:11.948533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:16:11.948533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:16:11.948533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 53fb2504-1cdb-442a-a2e1-f9b992639ab6 could not be found. (HTTP 404) (Request-ID: req-ae3c7c17-779e-41a8-b4df-323384c9951c) Aug 05 20:16:11.948533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:16:11.948533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:11.948533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:16:11.950017 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:11.950017 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 20:16:11.950017 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 20:16:11.950017 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 20:16:11.950017 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 20:16:11.950017 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 20:16:11.950017 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 20:16:11.950017 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 20:16:11.950017 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 20:16:11.950017 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:16:11.950017 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:16:11.950017 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 20:16:11.950017 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 20:16:11.950017 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 20:16:11.950017 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 20:16:11.950017 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:16:11.950017 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:16:11.950017 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:16:11.950017 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:16:11.952701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:16:11.952701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:16:11.952701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:16:11.952701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:16:11.952701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 53fb2504-1cdb-442a-a2e1-f9b992639ab6 could not be found. Aug 05 20:16:11.952701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:16:11.952701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:11.952701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:16:11.952701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:11.952701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:11.952701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:11.952701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:16:11.952701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:16:11.952701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:16:11.952701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:16:11.952701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:16:11.952701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:16:11.952701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 20:16:11.952701 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:16:11.956129 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 53fb2504-1cdb-442a-a2e1-f9b992639ab6 could not be found. Aug 05 20:16:11.956129 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:16:11.956129 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:11.956129 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:16:11.956129 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:11.956129 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:11.956129 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:11.956129 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:16:11.956129 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:16:11.956129 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 53fb2504-1cdb-442a-a2e1-f9b992639ab6 could not be found. Aug 05 20:16:11.956129 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:16:11.956129 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-88d86c11-0382-469b-b66c-16a2e7f79ada tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] Returning 404 to user: Volume 53fb2504-1cdb-442a-a2e1-f9b992639ab6 could not be found. {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:16:11.956129 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-88d86c11-0382-469b-b66c-16a2e7f79ada tempest-VolumesSnapshotsTestJSON-325515921 tempest-VolumesSnapshotsTestJSON-325515921-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/53fb2504-1cdb-442a-a2e1-f9b992639ab6" status: 404 len: 109 microversion: 2.1 time: 0.043356 Aug 05 20:16:11.956129 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 609/1235] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Aug 5 20:16:11 2022] GET /compute/v2.1/os-volumes/53fb2504-1cdb-442a-a2e1-f9b992639ab6 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 20:16:12.602156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a6e67900-1701-460c-9d83-f571b3fd0136 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:12.604409 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a6e67900-1701-460c-9d83-f571b3fd0136 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:12.615787 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a6e67900-1701-460c-9d83-f571b3fd0136 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:12.616626 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a6e67900-1701-460c-9d83-f571b3fd0136 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:12.617268 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a6e67900-1701-460c-9d83-f571b3fd0136 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:12.618407 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a6e67900-1701-460c-9d83-f571b3fd0136 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:12.619120 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a6e67900-1701-460c-9d83-f571b3fd0136 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:12.620015 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a6e67900-1701-460c-9d83-f571b3fd0136 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:12.823341 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a6e67900-1701-460c-9d83-f571b3fd0136 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:16:12.835425 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a6e67900-1701-460c-9d83-f571b3fd0136 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 200 len: 1266 microversion: 2.1 time: 0.243612 Aug 05 20:16:12.849463 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 627/1236] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:16:12 2022] GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:16:13.845061 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-53c16312-112c-4d51-bac6-580bcdc86614 tempest-VolumesGetTestJSON-1189098707 tempest-VolumesGetTestJSON-1189098707-project] Action: 'create', calling method: .version_select at 0x7fe3e4496ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-386570217", "metadata": {"Type": "work"}}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:16:13.863654 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-67443f64-1b1f-4947-b0d1-5d948d91c35c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:13.864824 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-67443f64-1b1f-4947-b0d1-5d948d91c35c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:13.876724 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-67443f64-1b1f-4947-b0d1-5d948d91c35c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:13.877592 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-67443f64-1b1f-4947-b0d1-5d948d91c35c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:13.879188 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-67443f64-1b1f-4947-b0d1-5d948d91c35c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:13.880497 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-67443f64-1b1f-4947-b0d1-5d948d91c35c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:13.881358 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-67443f64-1b1f-4947-b0d1-5d948d91c35c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:13.882141 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-67443f64-1b1f-4947-b0d1-5d948d91c35c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:14.037332 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-67443f64-1b1f-4947-b0d1-5d948d91c35c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:16:14.047817 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-67443f64-1b1f-4947-b0d1-5d948d91c35c tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 200 len: 1452 microversion: 2.1 time: 0.191827 Aug 05 20:16:14.048845 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 628/1237] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:16:13 2022] GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 1452 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:16:14.069075 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-622d0902-a505-4f0b-b5c7-738633f16b3b tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:14.069777 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-622d0902-a505-4f0b-b5c7-738633f16b3b tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:16:14.076187 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-622d0902-a505-4f0b-b5c7-738633f16b3b tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:14.076935 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-622d0902-a505-4f0b-b5c7-738633f16b3b tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:14.077480 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-622d0902-a505-4f0b-b5c7-738633f16b3b tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:14.078849 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-622d0902-a505-4f0b-b5c7-738633f16b3b tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:14.079207 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-622d0902-a505-4f0b-b5c7-738633f16b3b tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:14.079631 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-622d0902-a505-4f0b-b5c7-738633f16b3b tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:14.217376 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-53c16312-112c-4d51-bac6-580bcdc86614 tempest-VolumesGetTestJSON-1189098707 tempest-VolumesGetTestJSON-1189098707-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.525771 Aug 05 20:16:14.224642 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 610/1238] 10.222.0.39 () {60 vars in 1156 bytes} [Fri Aug 5 20:16:13 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 529 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 05 20:16:14.236721 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-d750afcc-9027-4ac1-b57d-0d74b1f098f4 tempest-VolumesGetTestJSON-1189098707 tempest-VolumesGetTestJSON-1189098707-project] Calling method '.version_select at 0x7fe3e45b5040>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:14.260889 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-622d0902-a505-4f0b-b5c7-738633f16b3b tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:16:14.271155 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-622d0902-a505-4f0b-b5c7-738633f16b3b tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 200 len: 1452 microversion: 2.1 time: 0.205835 Aug 05 20:16:14.272568 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 629/1239] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:16:14 2022] GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 1452 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:16:14.322386 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-d750afcc-9027-4ac1-b57d-0d74b1f098f4 tempest-VolumesGetTestJSON-1189098707 tempest-VolumesGetTestJSON-1189098707-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/1264e395-4a5c-42b8-a163-3605bbfcfbc2" status: 200 len: 352 microversion: 2.1 time: 0.089984 Aug 05 20:16:14.323197 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 611/1240] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Aug 5 20:16:14 2022] GET /compute/v2.1/os-volumes/1264e395-4a5c-42b8-a163-3605bbfcfbc2 => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:15.342577 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-58ce2efa-8a16-434f-ba92-ce3193b09ceb tempest-VolumesGetTestJSON-1189098707 tempest-VolumesGetTestJSON-1189098707-project] Calling method '.version_select at 0x7fe3e46bdd30>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:15.424503 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-58ce2efa-8a16-434f-ba92-ce3193b09ceb tempest-VolumesGetTestJSON-1189098707 tempest-VolumesGetTestJSON-1189098707-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/1264e395-4a5c-42b8-a163-3605bbfcfbc2" status: 200 len: 353 microversion: 2.1 time: 0.085380 Aug 05 20:16:15.426234 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 630/1241] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Aug 5 20:16:15 2022] GET /compute/v2.1/os-volumes/1264e395-4a5c-42b8-a163-3605bbfcfbc2 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:15.440384 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-2d4bb7e4-5092-4670-93e7-487dcfdf7818 tempest-VolumesGetTestJSON-1189098707 tempest-VolumesGetTestJSON-1189098707-project] Calling method '.version_select at 0x7fe3e50115e0>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:15.519997 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-2d4bb7e4-5092-4670-93e7-487dcfdf7818 tempest-VolumesGetTestJSON-1189098707 tempest-VolumesGetTestJSON-1189098707-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/1264e395-4a5c-42b8-a163-3605bbfcfbc2" status: 200 len: 353 microversion: 2.1 time: 0.084545 Aug 05 20:16:15.520609 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 612/1242] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Aug 5 20:16:15 2022] GET /compute/v2.1/os-volumes/1264e395-4a5c-42b8-a163-3605bbfcfbc2 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:15.542420 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4d9d1b7d-6ad4-4a16-b725-716d9a55b7e6 tempest-VolumesGetTestJSON-1189098707 tempest-VolumesGetTestJSON-1189098707-project] Calling method '.version_select at 0x7fe3e4655820>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:15.620968 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-4d9d1b7d-6ad4-4a16-b725-716d9a55b7e6 tempest-VolumesGetTestJSON-1189098707 tempest-VolumesGetTestJSON-1189098707-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/1264e395-4a5c-42b8-a163-3605bbfcfbc2" status: 202 len: 0 microversion: 2.1 time: 0.083454 Aug 05 20:16:15.621848 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 631/1243] 10.222.0.39 () {58 vars in 1248 bytes} [Fri Aug 5 20:16:15 2022] DELETE /compute/v2.1/os-volumes/1264e395-4a5c-42b8-a163-3605bbfcfbc2 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:16:15.633775 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-12ee66a6-95da-44e8-a773-dc6d51c78c0c tempest-VolumesGetTestJSON-1189098707 tempest-VolumesGetTestJSON-1189098707-project] Calling method '.version_select at 0x7fe3e43b34c0>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:15.714835 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-12ee66a6-95da-44e8-a773-dc6d51c78c0c tempest-VolumesGetTestJSON-1189098707 tempest-VolumesGetTestJSON-1189098707-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/1264e395-4a5c-42b8-a163-3605bbfcfbc2" status: 200 len: 352 microversion: 2.1 time: 0.086694 Aug 05 20:16:15.715636 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 613/1244] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Aug 5 20:16:15 2022] GET /compute/v2.1/os-volumes/1264e395-4a5c-42b8-a163-3605bbfcfbc2 => generated 352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:16:16.734125 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-91fc752d-30a3-4f8a-a8ad-b99a6ce8b9c0 tempest-VolumesGetTestJSON-1189098707 tempest-VolumesGetTestJSON-1189098707-project] Calling method '.version_select at 0x7fe3e42eeb80>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:16:16.809579 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-91fc752d-30a3-4f8a-a8ad-b99a6ce8b9c0 tempest-VolumesGetTestJSON-1189098707 tempest-VolumesGetTestJSON-1189098707-project] HTTP exception thrown: Volume 1264e395-4a5c-42b8-a163-3605bbfcfbc2 could not be found. Aug 05 20:16:16.816894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-91fc752d-30a3-4f8a-a8ad-b99a6ce8b9c0 tempest-VolumesGetTestJSON-1189098707 tempest-VolumesGetTestJSON-1189098707-project] Request method failure captured: Aug 05 20:16:16.816894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: GET /compute/v2.1/os-volumes/1264e395-4a5c-42b8-a163-3605bbfcfbc2 HTTP/1.1 Aug 05 20:16:16.816894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:16:16.816894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:16:16.816894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:16:16.816894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:16:16.816894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:16:16.816894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:16:16.816894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:16:16.816894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:16:16.816894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XqNmvNEaj5DQ-LTKCY6oLdnHoPbF1BhWZGf23RkTtUet3YWMDtlsuT2zEadPjKqQ6lCiVMYTqYOh3OZp2oQr_yTsRmfS5YwZ9hsIBSE4O-gysjt3g1gibed03fUioT8BAvWcQTMAzOEnO01rIjioD9QdYoTxj0vHQodLRDfxAyf0wQ Aug 05 20:16:16.816894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:16:16.816894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:16:16.816894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:16:16.816894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:16:16.816894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:16:16.816894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:16:16.816894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: 985012e7b45949f5ae9980356d30e5af Aug 05 20:16:16.816894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-VolumesGetTestJSON-1189098707 Aug 05 20:16:16.816894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:16:16.816894 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:16:16.819728 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/985012e7b45949f5ae9980356d30e5af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/985012e7b45949f5ae9980356d30e5af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/985012e7b45949f5ae9980356d30e5af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_985012e7b45949f5ae9980356d30e5af", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:16:16.819728 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-VolumesGetTestJSON-1189098707 Aug 05 20:16:16.819728 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: 985012e7b45949f5ae9980356d30e5af Aug 05 20:16:16.819728 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-VolumesGetTestJSON-1189098707 Aug 05 20:16:16.819728 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-VolumesGetTestJSON-1189098707-project Aug 05 20:16:16.819728 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:16:16.819728 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:16:16.819728 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: b7202c1005f54d89bcc5fa87da62083d Aug 05 20:16:16.819728 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-VolumesGetTestJSON-1189098707-project Aug 05 20:16:16.819728 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: Aug 05 20:16:16.819728 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Volume 1264e395-4a5c-42b8-a163-3605bbfcfbc2 could not be found. Aug 05 20:16:16.819728 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'id': '1264e395-4a5c-42b8-a163-3605bbfcfbc2'} Aug 05 20:16:16.819728 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:16:16.821779 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:16.821779 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:16:16.821779 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:16:16.821779 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 20:16:16.821779 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 20:16:16.821779 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 20:16:16.821779 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 20:16:16.821779 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:16:16.821779 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:16:16.821779 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:16:16.821779 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:16:16.821779 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:16:16.821779 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:16:16.821779 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:16:16.821779 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:16:16.821779 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1264e395-4a5c-42b8-a163-3605bbfcfbc2 could not be found. (HTTP 404) (Request-ID: req-31fda43d-3fec-4155-8f4c-23bfe23c72de) Aug 05 20:16:16.821779 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:16:16.821779 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:16.821779 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:16:16.824496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:16.824496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 20:16:16.824496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 20:16:16.824496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 20:16:16.824496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 20:16:16.824496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 20:16:16.824496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 20:16:16.824496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 20:16:16.824496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 20:16:16.824496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:16:16.824496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:16:16.824496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 20:16:16.824496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 20:16:16.824496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 20:16:16.824496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 20:16:16.824496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:16:16.824496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:16:16.824496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:16:16.824496 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:16:16.828251 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:16:16.828251 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:16:16.828251 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:16:16.828251 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:16:16.828251 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1264e395-4a5c-42b8-a163-3605bbfcfbc2 could not be found. Aug 05 20:16:16.828251 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:16:16.828251 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:16.828251 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:16:16.828251 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:16.828251 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:16.828251 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:16.828251 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:16:16.828251 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:16:16.828251 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:16:16.828251 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:16:16.828251 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:16:16.828251 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:16:16.828251 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 20:16:16.828251 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:16:16.834563 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1264e395-4a5c-42b8-a163-3605bbfcfbc2 could not be found. Aug 05 20:16:16.834563 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:16:16.834563 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:16:16.834563 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:16:16.834563 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:16:16.834563 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:16:16.834563 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:16:16.834563 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:16:16.834563 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:16:16.834563 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1264e395-4a5c-42b8-a163-3605bbfcfbc2 could not be found. Aug 05 20:16:16.834563 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:16:16.834563 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-91fc752d-30a3-4f8a-a8ad-b99a6ce8b9c0 tempest-VolumesGetTestJSON-1189098707 tempest-VolumesGetTestJSON-1189098707-project] Returning 404 to user: Volume 1264e395-4a5c-42b8-a163-3605bbfcfbc2 could not be found. {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:16:16.834563 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-91fc752d-30a3-4f8a-a8ad-b99a6ce8b9c0 tempest-VolumesGetTestJSON-1189098707 tempest-VolumesGetTestJSON-1189098707-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/1264e395-4a5c-42b8-a163-3605bbfcfbc2" status: 404 len: 109 microversion: 2.1 time: 0.105377 Aug 05 20:16:16.837814 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-2b00836e-d283-4f2b-a5d4-9e70e20dccf3 req-3547b193-0820-4742-9514-c1d26bc4fac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f346a0be-3cbc-4049-b079-576f8c9196be", "tag": "dd271ba4-7623-4f70-8dfb-7497cc0f0c3d"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:16:16.839899 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 614/1245] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Aug 5 20:16:16 2022] GET /compute/v2.1/os-volumes/1264e395-4a5c-42b8-a163-3605bbfcfbc2 => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:16:16.855003 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-2b00836e-d283-4f2b-a5d4-9e70e20dccf3 req-3547b193-0820-4742-9514-c1d26bc4fac7 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:16:16.856810 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-2b00836e-d283-4f2b-a5d4-9e70e20dccf3 req-3547b193-0820-4742-9514-c1d26bc4fac7 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:16:16.858162 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-2b00836e-d283-4f2b-a5d4-9e70e20dccf3 req-3547b193-0820-4742-9514-c1d26bc4fac7 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:16:16.882076 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-2b00836e-d283-4f2b-a5d4-9e70e20dccf3 req-3547b193-0820-4742-9514-c1d26bc4fac7 service nova] Creating event network-changed:dd271ba4-7623-4f70-8dfb-7497cc0f0c3d for instance f346a0be-3cbc-4049-b079-576f8c9196be on hv-cinder-85221 Aug 05 20:16:16.893388 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-2b00836e-d283-4f2b-a5d4-9e70e20dccf3 req-3547b193-0820-4742-9514-c1d26bc4fac7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.321239 Aug 05 20:16:16.903824 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 632/1246] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:17:11.653554 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:17:11.654316 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:17:11.658847 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-56d3e390-c7da-4122-84cb-8019f0cd8ac0 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:17:11.661199 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-56d3e390-c7da-4122-84cb-8019f0cd8ac0 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:17:11.672438 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-56d3e390-c7da-4122-84cb-8019f0cd8ac0 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:11.672986 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-56d3e390-c7da-4122-84cb-8019f0cd8ac0 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:11.673426 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-56d3e390-c7da-4122-84cb-8019f0cd8ac0 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:11.674135 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-56d3e390-c7da-4122-84cb-8019f0cd8ac0 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:11.674590 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-56d3e390-c7da-4122-84cb-8019f0cd8ac0 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:11.675015 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-56d3e390-c7da-4122-84cb-8019f0cd8ac0 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:11.705797 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-56d3e390-c7da-4122-84cb-8019f0cd8ac0 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053902 Aug 05 20:17:11.706355 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 615/1247] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Aug 5 20:17:11 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:17:11.768053 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=9 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:17:11.768823 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=60 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:17:11.773145 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-de717740-c483-4007-a9d9-6b6e3b6702db tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:17:11.773734 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-de717740-c483-4007-a9d9-6b6e3b6702db tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:17:11.780636 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de717740-c483-4007-a9d9-6b6e3b6702db tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:11.781441 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de717740-c483-4007-a9d9-6b6e3b6702db tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:11.781804 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de717740-c483-4007-a9d9-6b6e3b6702db tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:11.782522 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de717740-c483-4007-a9d9-6b6e3b6702db tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:11.782984 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de717740-c483-4007-a9d9-6b6e3b6702db tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:11.783411 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-de717740-c483-4007-a9d9-6b6e3b6702db tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:11.809726 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-de717740-c483-4007-a9d9-6b6e3b6702db tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Going to try to terminate instance {{(pid=118192) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:17:11.897827 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-de717740-c483-4007-a9d9-6b6e3b6702db tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 204 len: 0 microversion: 2.1 time: 0.131151 Aug 05 20:17:11.898445 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 633/1248] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:17:11 2022] DELETE /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:17:11.908013 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-07ff2624-738e-4754-9252-58f7f94c3a4e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:17:11.908013 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-07ff2624-738e-4754-9252-58f7f94c3a4e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:17:11.914198 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-07ff2624-738e-4754-9252-58f7f94c3a4e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:11.914787 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-07ff2624-738e-4754-9252-58f7f94c3a4e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:11.915230 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-07ff2624-738e-4754-9252-58f7f94c3a4e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:11.915939 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-07ff2624-738e-4754-9252-58f7f94c3a4e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:11.916398 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-07ff2624-738e-4754-9252-58f7f94c3a4e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:11.916851 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-07ff2624-738e-4754-9252-58f7f94c3a4e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:12.067720 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-07ff2624-738e-4754-9252-58f7f94c3a4e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:17:12.078655 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-07ff2624-738e-4754-9252-58f7f94c3a4e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1673 microversion: 2.1 time: 0.175191 Aug 05 20:17:12.079462 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 616/1249] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:17:11 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1673 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:17:13.101440 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-f860e5a1-bfe4-47ff-b5e9-b9b41e5695ec tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:17:13.102241 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-f860e5a1-bfe4-47ff-b5e9-b9b41e5695ec tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:17:13.108787 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f860e5a1-bfe4-47ff-b5e9-b9b41e5695ec tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:13.109868 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f860e5a1-bfe4-47ff-b5e9-b9b41e5695ec tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:13.110928 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f860e5a1-bfe4-47ff-b5e9-b9b41e5695ec tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:13.111647 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f860e5a1-bfe4-47ff-b5e9-b9b41e5695ec tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:13.112107 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f860e5a1-bfe4-47ff-b5e9-b9b41e5695ec tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:13.112545 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f860e5a1-bfe4-47ff-b5e9-b9b41e5695ec tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:13.249002 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-f860e5a1-bfe4-47ff-b5e9-b9b41e5695ec tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:17:13.262143 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-f860e5a1-bfe4-47ff-b5e9-b9b41e5695ec tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1673 microversion: 2.1 time: 0.164684 Aug 05 20:17:13.263184 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 634/1250] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:17:13 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:17:14.286178 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-d365c71a-010a-46f2-9e59-db24eb8f6b15 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:17:14.286951 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-d365c71a-010a-46f2-9e59-db24eb8f6b15 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:17:14.294975 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d365c71a-010a-46f2-9e59-db24eb8f6b15 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:14.295349 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d365c71a-010a-46f2-9e59-db24eb8f6b15 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:14.295794 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d365c71a-010a-46f2-9e59-db24eb8f6b15 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:14.296502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d365c71a-010a-46f2-9e59-db24eb8f6b15 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:14.297588 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d365c71a-010a-46f2-9e59-db24eb8f6b15 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:14.298026 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d365c71a-010a-46f2-9e59-db24eb8f6b15 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:14.434498 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-d365c71a-010a-46f2-9e59-db24eb8f6b15 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:17:14.442690 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-d365c71a-010a-46f2-9e59-db24eb8f6b15 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1673 microversion: 2.1 time: 0.161144 Aug 05 20:17:14.443274 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 617/1251] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:17:14 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:17:15.466235 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-9fed9ff3-9b2d-453a-8296-8b3754608ccd tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:17:15.467361 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-9fed9ff3-9b2d-453a-8296-8b3754608ccd tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:17:15.476157 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9fed9ff3-9b2d-453a-8296-8b3754608ccd tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:15.477095 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9fed9ff3-9b2d-453a-8296-8b3754608ccd tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:15.477894 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9fed9ff3-9b2d-453a-8296-8b3754608ccd tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:15.478871 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9fed9ff3-9b2d-453a-8296-8b3754608ccd tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:15.479548 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9fed9ff3-9b2d-453a-8296-8b3754608ccd tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:15.480851 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-9fed9ff3-9b2d-453a-8296-8b3754608ccd tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:15.566648 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-3d5b2d89-fd7b-4082-aea0-7bb8394807e8 req-0b549006-f047-45df-9adb-884d36dca6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4512b727-5582-4e39-ba18-58b3c42b79f0", "name": "network-vif-deleted", "tag": "9d910af6-21ba-4feb-b1a1-74ae74dc2d0e"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:17:15.592358 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-9fed9ff3-9b2d-453a-8296-8b3754608ccd tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:17:15.593874 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-3d5b2d89-fd7b-4082-aea0-7bb8394807e8 req-0b549006-f047-45df-9adb-884d36dca6d5 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:15.594740 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-3d5b2d89-fd7b-4082-aea0-7bb8394807e8 req-0b549006-f047-45df-9adb-884d36dca6d5 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:15.595424 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-3d5b2d89-fd7b-4082-aea0-7bb8394807e8 req-0b549006-f047-45df-9adb-884d36dca6d5 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:15.603473 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-9fed9ff3-9b2d-453a-8296-8b3754608ccd tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 200 len: 1606 microversion: 2.1 time: 0.141590 Aug 05 20:17:15.604620 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 635/1252] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:17:15 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 1606 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:17:15.628565 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-3d5b2d89-fd7b-4082-aea0-7bb8394807e8 req-0b549006-f047-45df-9adb-884d36dca6d5 service nova] Creating event network-vif-deleted:9d910af6-21ba-4feb-b1a1-74ae74dc2d0e for instance 4512b727-5582-4e39-ba18-58b3c42b79f0 on hv-cinder-85221 Aug 05 20:17:15.634683 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-3d5b2d89-fd7b-4082-aea0-7bb8394807e8 req-0b549006-f047-45df-9adb-884d36dca6d5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084200 Aug 05 20:17:15.635583 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 618/1253] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:17:16.628440 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-5e023e86-b68b-4827-a2b2-74cb4c3303b9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:17:16.629327 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-5e023e86-b68b-4827-a2b2-74cb4c3303b9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:17:16.635994 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5e023e86-b68b-4827-a2b2-74cb4c3303b9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:16.636494 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5e023e86-b68b-4827-a2b2-74cb4c3303b9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:16.636988 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5e023e86-b68b-4827-a2b2-74cb4c3303b9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:16.637704 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5e023e86-b68b-4827-a2b2-74cb4c3303b9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:16.638170 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5e023e86-b68b-4827-a2b2-74cb4c3303b9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:16.638601 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-5e023e86-b68b-4827-a2b2-74cb4c3303b9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:16.654267 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-5e023e86-b68b-4827-a2b2-74cb4c3303b9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] HTTP exception thrown: Instance 4512b727-5582-4e39-ba18-58b3c42b79f0 could not be found. Aug 05 20:17:16.655937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-5e023e86-b68b-4827-a2b2-74cb4c3303b9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Request method failure captured: Aug 05 20:17:16.655937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 HTTP/1.1 Aug 05 20:17:16.655937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:17:16.655937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:17:16.655937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:17:16.655937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 0 Aug 05 20:17:16.655937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:17:16.655937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:17:16.655937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:17:16.655937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:17:16.655937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XmXv3VSfnlBKrwyzZo0upQLfZZhWc1R88wTLpPYBPFzo6DADXU4k-ZUhjUkibgdBtjHtHw99mfvPe9gQl6pV5S3s-t-SLPCPYr6R4OC0c20T9hlbOUa_Ju24yHFLtRQagRitlbXqYyk7z2reWJraXuPNdu140ZeiR2I7Sg5-PBp5iI Aug 05 20:17:16.655937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:17:16.655937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:17:16.655937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:17:16.655937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:17:16.655937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:17:16.655937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:17:16.655937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: 790b5019b9114120a51718d99317f7a1 Aug 05 20:17:16.655937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-AttachVolumeTestJSON-1174647915 Aug 05 20:17:16.655937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:17:16.655937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:17:16.659858 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/790b5019b9114120a51718d99317f7a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/790b5019b9114120a51718d99317f7a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/790b5019b9114120a51718d99317f7a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_790b5019b9114120a51718d99317f7a1", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:17:16.659858 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-AttachVolumeTestJSON-1174647915 Aug 05 20:17:16.659858 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: 790b5019b9114120a51718d99317f7a1 Aug 05 20:17:16.659858 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1174647915 Aug 05 20:17:16.659858 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-AttachVolumeTestJSON-1174647915-project Aug 05 20:17:16.659858 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:17:16.659858 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:17:16.659858 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: 305d1ce79a4f43c8b98e0967dab43da1 Aug 05 20:17:16.659858 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-AttachVolumeTestJSON-1174647915-project Aug 05 20:17:16.659858 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: > Aug 05 20:17:16.659858 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Instance 4512b727-5582-4e39-ba18-58b3c42b79f0 could not be found. Aug 05 20:17:16.659858 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'id': '4512b727-5582-4e39-ba18-58b3c42b79f0'} Aug 05 20:17:16.663057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:17:16.663057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:17:16.663057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:17:16.663057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:17:16.663057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:17:16.663057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:17:16.663057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:17:16.663057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:17:16.663057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:17:16.663057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:17:16.663057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4512b727-5582-4e39-ba18-58b3c42b79f0 could not be found. Aug 05 20:17:16.663057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:17:16.663057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:17:16.663057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:17:16.663057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:17:16.663057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:17:16.663057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:17:16.663057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:17:16.663057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:17:16.663057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:17:16.666247 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:17:16.666247 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:17:16.666247 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:17:16.666247 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:17:16.666247 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:17:16.666247 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:17:16.666247 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:17:16.666247 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4512b727-5582-4e39-ba18-58b3c42b79f0 could not be found. Aug 05 20:17:16.666247 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:17:16.666247 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:17:16.666247 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:17:16.666247 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:17:16.666247 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:17:16.666247 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:17:16.666247 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:17:16.666247 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:17:16.666247 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4512b727-5582-4e39-ba18-58b3c42b79f0 could not be found. Aug 05 20:17:16.666247 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:17:16.668967 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-5e023e86-b68b-4827-a2b2-74cb4c3303b9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Returning 404 to user: Instance 4512b727-5582-4e39-ba18-58b3c42b79f0 could not be found. {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:17:16.668967 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-5e023e86-b68b-4827-a2b2-74cb4c3303b9 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 404 len: 111 microversion: 2.1 time: 0.034355 Aug 05 20:17:16.668967 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 636/1254] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:17:16 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 20:17:16.671071 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-14c47350-5e0c-409d-9e0c-9ba37e00f392 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '.version_select at 0x7fe3e51310d0>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:17:16.691884 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-14c47350-5e0c-409d-9e0c-9ba37e00f392 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-767842823" status: 202 len: 0 microversion: 2.1 time: 0.027827 Aug 05 20:17:16.692480 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 619/1255] 10.222.0.39 () {58 vars in 1218 bytes} [Fri Aug 5 20:17:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-767842823 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 20:17:17.446972 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b6dcb1d3-2873-479f-9131-60822f7de172 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Action: 'create', calling method: .version_select at 0x7fe3e4485c10>, body: {"keypair": {"name": "tempest-keypair-1190103166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8iZ0Z52JdAApXL/Cosi24H8U+HzzdsGdy7qj5BXNbV8MXGVIaoOHBdZ6raug+AXTUi0CWdv8qXHl0H5Q8lzTE6mHcBX6JJRmSRP7n6uGN0Gk+WREoxhjdXo9jm7cshEg=="}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:17:17.471848 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-b6dcb1d3-2873-479f-9131-60822f7de172 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Getting quotas for project 790b5019b9114120a51718d99317f7a1. Resources: {'key_pairs'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:17:17.475749 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.quota [None req-b6dcb1d3-2873-479f-9131-60822f7de172 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Getting quotas for user 305d1ce79a4f43c8b98e0967dab43da1 and project 790b5019b9114120a51718d99317f7a1. Resources: {'key_pairs'} {{(pid=118192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:17:17.502682 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b6dcb1d3-2873-479f-9131-60822f7de172 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059584 Aug 05 20:17:17.503440 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 637/1256] 10.222.0.39 () {60 vars in 1159 bytes} [Fri Aug 5 20:17:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:17:18.862146 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f4f091f1-7962-4688-8d3f-94b626ebff89 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1132772093", "imageRef": "c148255e-9574-4d10-b9bb-13c9411eda77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f6011fa2-4a48-4874-a9b5-7ab01c637069"}], "security_groups": [{"name": "tempest-securitygroup--237046410"}], "key_name": "tempest-keypair-1190103166", "user_data": "}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:17:18.975166 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.network.neutron [None req-f4f091f1-7962-4688-8d3f-94b626ebff89 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] validate_networks() for [('f6011fa2-4a48-4874-a9b5-7ab01c637069', None, None, None, None, None)] {{(pid=118191) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:17:19.660855 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-f4f091f1-7962-4688-8d3f-94b626ebff89 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Flavor limits 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:17:19.661615 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-f4f091f1-7962-4688-8d3f-94b626ebff89 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Image limits 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:17:19.662493 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-f4f091f1-7962-4688-8d3f-94b626ebff89 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Flavor pref 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:17:19.663246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-f4f091f1-7962-4688-8d3f-94b626ebff89 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Image pref 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:17:19.663875 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-f4f091f1-7962-4688-8d3f-94b626ebff89 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:17:19.675270 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f4f091f1-7962-4688-8d3f-94b626ebff89 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:19.675879 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f4f091f1-7962-4688-8d3f-94b626ebff89 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:19.676381 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f4f091f1-7962-4688-8d3f-94b626ebff89 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:19.677529 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f4f091f1-7962-4688-8d3f-94b626ebff89 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:19.678161 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f4f091f1-7962-4688-8d3f-94b626ebff89 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:19.678707 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f4f091f1-7962-4688-8d3f-94b626ebff89 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:19.704555 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-f4f091f1-7962-4688-8d3f-94b626ebff89 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Getting quotas for project 790b5019b9114120a51718d99317f7a1. Resources: {'cores', 'ram', 'instances'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:17:19.711833 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-f4f091f1-7962-4688-8d3f-94b626ebff89 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Getting quotas for user 305d1ce79a4f43c8b98e0967dab43da1 and project 790b5019b9114120a51718d99317f7a1. Resources: {'cores', 'ram', 'instances'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:17:19.732286 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f4f091f1-7962-4688-8d3f-94b626ebff89 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Going to run 1 instances... {{(pid=118191) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:17:19.735936 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f4f091f1-7962-4688-8d3f-94b626ebff89 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c148255e-9574-4d10-b9bb-13c9411eda77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118191) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:17:19.786413 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f4f091f1-7962-4688-8d3f-94b626ebff89 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.929674 Aug 05 20:17:19.787391 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 620/1257] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Aug 5 20:17:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:17:19.801077 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-62021376-322b-493f-9365-cd6f3aac9030 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:17:19.801972 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-62021376-322b-493f-9365-cd6f3aac9030 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:17:19.883030 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-62021376-322b-493f-9365-cd6f3aac9030 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:17:19.892713 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-62021376-322b-493f-9365-cd6f3aac9030 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7" status: 200 len: 1238 microversion: 2.1 time: 0.096177 Aug 05 20:17:19.893419 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 638/1258] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:17:19 2022] GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7 => generated 1238 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:17:20.916057 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-0c2588d6-57e8-4940-8641-417c42428ccf tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:17:20.916814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-0c2588d6-57e8-4940-8641-417c42428ccf tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:17:20.924982 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0c2588d6-57e8-4940-8641-417c42428ccf tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:20.925560 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0c2588d6-57e8-4940-8641-417c42428ccf tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:20.926005 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0c2588d6-57e8-4940-8641-417c42428ccf tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:20.926769 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0c2588d6-57e8-4940-8641-417c42428ccf tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:20.927187 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0c2588d6-57e8-4940-8641-417c42428ccf tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:20.927619 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0c2588d6-57e8-4940-8641-417c42428ccf tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:21.050209 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-0c2588d6-57e8-4940-8641-417c42428ccf tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:17:21.064315 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-0c2588d6-57e8-4940-8641-417c42428ccf tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7" status: 200 len: 1298 microversion: 2.1 time: 0.152390 Aug 05 20:17:21.076823 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 621/1259] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:17:20 2022] GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7 => generated 1298 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:17:22.090718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a93ecbe3-d7d9-41bc-a1b4-2da0d248236c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:17:22.091523 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a93ecbe3-d7d9-41bc-a1b4-2da0d248236c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:17:22.098963 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a93ecbe3-d7d9-41bc-a1b4-2da0d248236c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:22.099435 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a93ecbe3-d7d9-41bc-a1b4-2da0d248236c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:22.099871 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a93ecbe3-d7d9-41bc-a1b4-2da0d248236c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:22.100591 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a93ecbe3-d7d9-41bc-a1b4-2da0d248236c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:22.101055 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a93ecbe3-d7d9-41bc-a1b4-2da0d248236c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:22.101483 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a93ecbe3-d7d9-41bc-a1b4-2da0d248236c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:22.291193 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-a93ecbe3-d7d9-41bc-a1b4-2da0d248236c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:17:22.300287 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a93ecbe3-d7d9-41bc-a1b4-2da0d248236c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7" status: 200 len: 1363 microversion: 2.1 time: 0.213283 Aug 05 20:17:22.300917 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 639/1260] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:17:22 2022] GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:17:22.589840 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-7d414932-7edc-4272-9dab-94ccae3072b5 req-496aeb49-90bf-4c64-aab0-f9d5472a6da7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81bf9fdf-5b58-462f-9d79-4405217fcdf7", "tag": "b6f27fbd-9609-4402-8959-485aba416770"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:17:22.601401 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-7d414932-7edc-4272-9dab-94ccae3072b5 req-496aeb49-90bf-4c64-aab0-f9d5472a6da7 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:22.601890 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-7d414932-7edc-4272-9dab-94ccae3072b5 req-496aeb49-90bf-4c64-aab0-f9d5472a6da7 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:22.602316 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-7d414932-7edc-4272-9dab-94ccae3072b5 req-496aeb49-90bf-4c64-aab0-f9d5472a6da7 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:22.622082 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-7d414932-7edc-4272-9dab-94ccae3072b5 req-496aeb49-90bf-4c64-aab0-f9d5472a6da7 service nova] Creating event network-changed:b6f27fbd-9609-4402-8959-485aba416770 for instance 81bf9fdf-5b58-462f-9d79-4405217fcdf7 on hv-cinder-85221 Aug 05 20:17:22.631448 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-7d414932-7edc-4272-9dab-94ccae3072b5 req-496aeb49-90bf-4c64-aab0-f9d5472a6da7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044700 Aug 05 20:17:22.632553 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 622/1261] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:17:23.322636 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-d393610a-9001-4f6b-9fea-a2b91d72a6af tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:17:23.323292 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-d393610a-9001-4f6b-9fea-a2b91d72a6af tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:17:23.330566 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d393610a-9001-4f6b-9fea-a2b91d72a6af tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:23.331058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d393610a-9001-4f6b-9fea-a2b91d72a6af tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:23.331496 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d393610a-9001-4f6b-9fea-a2b91d72a6af tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:23.332259 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d393610a-9001-4f6b-9fea-a2b91d72a6af tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:23.332686 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d393610a-9001-4f6b-9fea-a2b91d72a6af tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:23.333116 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d393610a-9001-4f6b-9fea-a2b91d72a6af tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:23.493971 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-d393610a-9001-4f6b-9fea-a2b91d72a6af tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:17:23.507613 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-d393610a-9001-4f6b-9fea-a2b91d72a6af tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7" status: 200 len: 1363 microversion: 2.1 time: 0.188929 Aug 05 20:17:23.508629 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 640/1262] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:17:23 2022] GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:17:24.532569 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-0fb7a6a9-7468-431c-9c76-04ec0f315397 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:17:24.533216 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-0fb7a6a9-7468-431c-9c76-04ec0f315397 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:17:24.545692 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0fb7a6a9-7468-431c-9c76-04ec0f315397 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:24.546180 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0fb7a6a9-7468-431c-9c76-04ec0f315397 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:24.546697 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0fb7a6a9-7468-431c-9c76-04ec0f315397 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:24.547398 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0fb7a6a9-7468-431c-9c76-04ec0f315397 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:24.547850 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0fb7a6a9-7468-431c-9c76-04ec0f315397 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:24.548290 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0fb7a6a9-7468-431c-9c76-04ec0f315397 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:24.689370 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-0fb7a6a9-7468-431c-9c76-04ec0f315397 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:17:24.697093 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-0fb7a6a9-7468-431c-9c76-04ec0f315397 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7" status: 200 len: 1363 microversion: 2.1 time: 0.169398 Aug 05 20:17:24.697659 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 623/1263] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:17:24 2022] GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:17:25.724311 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-788b8243-0463-4519-a4df-30311a0b786a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:17:25.725130 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-788b8243-0463-4519-a4df-30311a0b786a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:17:25.731130 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-788b8243-0463-4519-a4df-30311a0b786a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:25.731624 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-788b8243-0463-4519-a4df-30311a0b786a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:25.732067 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-788b8243-0463-4519-a4df-30311a0b786a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:25.732882 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-788b8243-0463-4519-a4df-30311a0b786a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:25.733349 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-788b8243-0463-4519-a4df-30311a0b786a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:25.733781 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-788b8243-0463-4519-a4df-30311a0b786a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:25.998021 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-788b8243-0463-4519-a4df-30311a0b786a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:17:26.008653 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-788b8243-0463-4519-a4df-30311a0b786a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7" status: 200 len: 1363 microversion: 2.1 time: 0.290182 Aug 05 20:17:26.009504 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 641/1264] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:17:25 2022] GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7 => generated 1363 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:17:27.035645 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f02f53e8-5195-4d33-a36d-d1d683c058e3 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:17:27.036265 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f02f53e8-5195-4d33-a36d-d1d683c058e3 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:17:27.054136 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f02f53e8-5195-4d33-a36d-d1d683c058e3 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:27.055319 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f02f53e8-5195-4d33-a36d-d1d683c058e3 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:27.056787 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f02f53e8-5195-4d33-a36d-d1d683c058e3 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:27.057680 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f02f53e8-5195-4d33-a36d-d1d683c058e3 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:27.058150 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f02f53e8-5195-4d33-a36d-d1d683c058e3 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:27.058586 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f02f53e8-5195-4d33-a36d-d1d683c058e3 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:27.226417 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f02f53e8-5195-4d33-a36d-d1d683c058e3 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:17:27.234289 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f02f53e8-5195-4d33-a36d-d1d683c058e3 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7" status: 200 len: 1363 microversion: 2.1 time: 0.203046 Aug 05 20:17:27.234875 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 624/1265] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:17:27 2022] GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:17:28.255608 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-f4165881-ffab-4ac1-9562-1a70b62d5c81 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:17:28.256393 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-f4165881-ffab-4ac1-9562-1a70b62d5c81 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:17:28.265909 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f4165881-ffab-4ac1-9562-1a70b62d5c81 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:28.266400 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f4165881-ffab-4ac1-9562-1a70b62d5c81 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:28.266841 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f4165881-ffab-4ac1-9562-1a70b62d5c81 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:28.267565 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f4165881-ffab-4ac1-9562-1a70b62d5c81 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:28.268084 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f4165881-ffab-4ac1-9562-1a70b62d5c81 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:28.268554 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f4165881-ffab-4ac1-9562-1a70b62d5c81 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:28.447925 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-f4165881-ffab-4ac1-9562-1a70b62d5c81 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:17:28.459679 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-f4165881-ffab-4ac1-9562-1a70b62d5c81 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7" status: 200 len: 1363 microversion: 2.1 time: 0.208110 Aug 05 20:17:28.460284 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 642/1266] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:17:28 2022] GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:17:28.990002 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-72da3716-50e3-482d-be87-7b0226e98363 req-723a791d-188b-4386-b4e8-f6e96ffa4a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81bf9fdf-5b58-462f-9d79-4405217fcdf7", "name": "network-vif-plugged", "status": "completed", "tag": "b6f27fbd-9609-4402-8959-485aba416770"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:17:29.009693 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-72da3716-50e3-482d-be87-7b0226e98363 req-723a791d-188b-4386-b4e8-f6e96ffa4a9d service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:29.010188 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-72da3716-50e3-482d-be87-7b0226e98363 req-723a791d-188b-4386-b4e8-f6e96ffa4a9d service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:29.010637 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-72da3716-50e3-482d-be87-7b0226e98363 req-723a791d-188b-4386-b4e8-f6e96ffa4a9d service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:29.023638 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-72da3716-50e3-482d-be87-7b0226e98363 req-723a791d-188b-4386-b4e8-f6e96ffa4a9d service nova] Creating event network-vif-plugged:b6f27fbd-9609-4402-8959-485aba416770 for instance 81bf9fdf-5b58-462f-9d79-4405217fcdf7 on hv-cinder-85221 Aug 05 20:17:29.028816 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-72da3716-50e3-482d-be87-7b0226e98363 req-723a791d-188b-4386-b4e8-f6e96ffa4a9d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043666 Aug 05 20:17:29.029428 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 625/1267] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:17:29.481964 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-0836e745-d937-4b6b-ae94-2d3afd8886b6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:17:29.482601 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-0836e745-d937-4b6b-ae94-2d3afd8886b6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:17:29.489996 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0836e745-d937-4b6b-ae94-2d3afd8886b6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:29.490490 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0836e745-d937-4b6b-ae94-2d3afd8886b6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:29.490930 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0836e745-d937-4b6b-ae94-2d3afd8886b6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:29.491634 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0836e745-d937-4b6b-ae94-2d3afd8886b6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:29.492091 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0836e745-d937-4b6b-ae94-2d3afd8886b6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:29.492523 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0836e745-d937-4b6b-ae94-2d3afd8886b6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:29.641473 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-0836e745-d937-4b6b-ae94-2d3afd8886b6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:17:29.649910 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-0836e745-d937-4b6b-ae94-2d3afd8886b6 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7" status: 200 len: 1363 microversion: 2.1 time: 0.171767 Aug 05 20:17:29.650538 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 643/1268] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:17:29 2022] GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:17:30.675798 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-6f27a7de-88bf-4ee9-a300-0cd4389be39c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:17:30.676899 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-6f27a7de-88bf-4ee9-a300-0cd4389be39c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:17:30.678938 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=2 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:17:30.679622 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=6 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:17:30.686361 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6f27a7de-88bf-4ee9-a300-0cd4389be39c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:30.686853 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6f27a7de-88bf-4ee9-a300-0cd4389be39c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:30.687325 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6f27a7de-88bf-4ee9-a300-0cd4389be39c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:30.688035 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6f27a7de-88bf-4ee9-a300-0cd4389be39c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:30.688490 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6f27a7de-88bf-4ee9-a300-0cd4389be39c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:30.688946 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6f27a7de-88bf-4ee9-a300-0cd4389be39c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:30.846725 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-6f27a7de-88bf-4ee9-a300-0cd4389be39c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:17:30.857203 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-6f27a7de-88bf-4ee9-a300-0cd4389be39c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7" status: 200 len: 1363 microversion: 2.1 time: 0.188473 Aug 05 20:17:30.857801 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 626/1269] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:17:30 2022] GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:17:31.880653 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-7ec4a947-5293-455f-bca7-a769c2a89352 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:17:31.881819 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-7ec4a947-5293-455f-bca7-a769c2a89352 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:17:31.884037 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell0:SELECT=6 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:17:31.890128 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7ec4a947-5293-455f-bca7-a769c2a89352 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:31.890764 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7ec4a947-5293-455f-bca7-a769c2a89352 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:31.891179 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7ec4a947-5293-455f-bca7-a769c2a89352 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:31.891893 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7ec4a947-5293-455f-bca7-a769c2a89352 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:31.892341 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7ec4a947-5293-455f-bca7-a769c2a89352 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:31.892800 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-7ec4a947-5293-455f-bca7-a769c2a89352 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:32.038190 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-7ec4a947-5293-455f-bca7-a769c2a89352 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:17:32.053291 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-7ec4a947-5293-455f-bca7-a769c2a89352 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7" status: 200 len: 1549 microversion: 2.1 time: 0.177486 Aug 05 20:17:32.053897 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 644/1270] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:17:31 2022] GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7 => generated 1549 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:17:32.077966 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-d90a6862-f606-4cec-a6be-5d4835e76883 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:17:32.078845 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-d90a6862-f606-4cec-a6be-5d4835e76883 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:17:32.086988 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d90a6862-f606-4cec-a6be-5d4835e76883 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:32.087484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d90a6862-f606-4cec-a6be-5d4835e76883 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:32.087929 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d90a6862-f606-4cec-a6be-5d4835e76883 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:32.088672 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d90a6862-f606-4cec-a6be-5d4835e76883 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:32.089130 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d90a6862-f606-4cec-a6be-5d4835e76883 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:32.089558 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d90a6862-f606-4cec-a6be-5d4835e76883 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:32.200906 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-d90a6862-f606-4cec-a6be-5d4835e76883 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125816 Aug 05 20:17:32.201373 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 627/1271] 10.222.0.39 () {58 vars in 1275 bytes} [Fri Aug 5 20:17:32 2022] GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:17:33.245424 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-4b6d95d3-1926-4396-b9f7-02799ec60ae0 req-ab846335-7e93-4bb7-ab37-8abf3470778a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81bf9fdf-5b58-462f-9d79-4405217fcdf7", "tag": "b6f27fbd-9609-4402-8959-485aba416770"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:17:33.257628 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-4b6d95d3-1926-4396-b9f7-02799ec60ae0 req-ab846335-7e93-4bb7-ab37-8abf3470778a service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:17:33.258113 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-4b6d95d3-1926-4396-b9f7-02799ec60ae0 req-ab846335-7e93-4bb7-ab37-8abf3470778a service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:17:33.258537 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-4b6d95d3-1926-4396-b9f7-02799ec60ae0 req-ab846335-7e93-4bb7-ab37-8abf3470778a service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:17:33.271010 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-4b6d95d3-1926-4396-b9f7-02799ec60ae0 req-ab846335-7e93-4bb7-ab37-8abf3470778a service nova] Creating event network-changed:b6f27fbd-9609-4402-8959-485aba416770 for instance 81bf9fdf-5b58-462f-9d79-4405217fcdf7 on hv-cinder-85221 Aug 05 20:17:33.276850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-4b6d95d3-1926-4396-b9f7-02799ec60ae0 req-ab846335-7e93-4bb7-ab37-8abf3470778a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035000 Aug 05 20:17:33.277617 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 645/1272] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:18:21.170417 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:18:21.171844 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:18:21.172489 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=54 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:18:21.173039 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:18:21.178034 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-dfefc120-d869-4ed1-8597-bf4dd16be226 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:18:21.178671 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-dfefc120-d869-4ed1-8597-bf4dd16be226 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:18:21.181763 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-a36690a3-9875-478a-b820-c94f0e8d5c3a req-c66d2722-8344-48ce-a651-992e7e129106 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f346a0be-3cbc-4049-b079-576f8c9196be", "tag": "dd271ba4-7623-4f70-8dfb-7497cc0f0c3d"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:18:21.187975 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dfefc120-d869-4ed1-8597-bf4dd16be226 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:21.188710 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dfefc120-d869-4ed1-8597-bf4dd16be226 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:21.189256 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dfefc120-d869-4ed1-8597-bf4dd16be226 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:21.190275 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dfefc120-d869-4ed1-8597-bf4dd16be226 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:21.190919 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dfefc120-d869-4ed1-8597-bf4dd16be226 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:21.192074 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-dfefc120-d869-4ed1-8597-bf4dd16be226 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:21.201115 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-a36690a3-9875-478a-b820-c94f0e8d5c3a req-c66d2722-8344-48ce-a651-992e7e129106 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:21.201599 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-a36690a3-9875-478a-b820-c94f0e8d5c3a req-c66d2722-8344-48ce-a651-992e7e129106 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:21.202040 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-a36690a3-9875-478a-b820-c94f0e8d5c3a req-c66d2722-8344-48ce-a651-992e7e129106 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:21.221205 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-a36690a3-9875-478a-b820-c94f0e8d5c3a req-c66d2722-8344-48ce-a651-992e7e129106 service nova] Creating event network-changed:dd271ba4-7623-4f70-8dfb-7497cc0f0c3d for instance f346a0be-3cbc-4049-b079-576f8c9196be on hv-cinder-85221 Aug 05 20:18:21.228882 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-a36690a3-9875-478a-b820-c94f0e8d5c3a req-c66d2722-8344-48ce-a651-992e7e129106 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059130 Aug 05 20:18:21.229758 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 646/1273] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:18:21.233335 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-dfefc120-d869-4ed1-8597-bf4dd16be226 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Going to try to terminate instance {{(pid=118191) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:18:21.352157 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-dfefc120-d869-4ed1-8597-bf4dd16be226 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 204 len: 0 microversion: 2.1 time: 0.183761 Aug 05 20:18:21.353309 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 628/1274] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:18:21 2022] DELETE /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:18:21.367280 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-e51fc2e4-e452-4b47-9cff-acdb48e3b171 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:18:21.368903 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-e51fc2e4-e452-4b47-9cff-acdb48e3b171 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:18:21.380232 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e51fc2e4-e452-4b47-9cff-acdb48e3b171 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:21.380990 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e51fc2e4-e452-4b47-9cff-acdb48e3b171 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:21.381769 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e51fc2e4-e452-4b47-9cff-acdb48e3b171 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:21.382816 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e51fc2e4-e452-4b47-9cff-acdb48e3b171 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:21.383458 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e51fc2e4-e452-4b47-9cff-acdb48e3b171 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:21.383985 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e51fc2e4-e452-4b47-9cff-acdb48e3b171 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:21.712489 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-e51fc2e4-e452-4b47-9cff-acdb48e3b171 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:18:21.720640 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-e51fc2e4-e452-4b47-9cff-acdb48e3b171 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 200 len: 1576 microversion: 2.1 time: 0.359868 Aug 05 20:18:21.721266 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 647/1275] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:18:21 2022] GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 1576 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:18:22.744649 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-16371843-dc05-4d85-bb16-ff475f4d08c9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:18:22.745396 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-16371843-dc05-4d85-bb16-ff475f4d08c9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:18:22.751804 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-16371843-dc05-4d85-bb16-ff475f4d08c9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:22.752286 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-16371843-dc05-4d85-bb16-ff475f4d08c9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:22.752759 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-16371843-dc05-4d85-bb16-ff475f4d08c9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:22.753452 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-16371843-dc05-4d85-bb16-ff475f4d08c9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:22.753912 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-16371843-dc05-4d85-bb16-ff475f4d08c9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:22.754336 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-16371843-dc05-4d85-bb16-ff475f4d08c9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:23.037867 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-16371843-dc05-4d85-bb16-ff475f4d08c9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:18:23.045501 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-16371843-dc05-4d85-bb16-ff475f4d08c9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 200 len: 1576 microversion: 2.1 time: 0.305186 Aug 05 20:18:23.046484 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 629/1276] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:18:22 2022] GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 1576 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:18:24.034744 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-13a3a9ac-8d57-40b1-8708-5dd7aa05af9f req-270a021c-e7a2-4a6d-b240-1e42d62f1b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f346a0be-3cbc-4049-b079-576f8c9196be", "name": "network-vif-deleted", "tag": "dd271ba4-7623-4f70-8dfb-7497cc0f0c3d"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:18:24.044628 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-13a3a9ac-8d57-40b1-8708-5dd7aa05af9f req-270a021c-e7a2-4a6d-b240-1e42d62f1b2e service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:24.045058 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-13a3a9ac-8d57-40b1-8708-5dd7aa05af9f req-270a021c-e7a2-4a6d-b240-1e42d62f1b2e service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:24.045486 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-13a3a9ac-8d57-40b1-8708-5dd7aa05af9f req-270a021c-e7a2-4a6d-b240-1e42d62f1b2e service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:24.057288 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-13a3a9ac-8d57-40b1-8708-5dd7aa05af9f req-270a021c-e7a2-4a6d-b240-1e42d62f1b2e service nova] Creating event network-vif-deleted:dd271ba4-7623-4f70-8dfb-7497cc0f0c3d for instance f346a0be-3cbc-4049-b079-576f8c9196be on hv-cinder-85221 Aug 05 20:18:24.062637 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-13a3a9ac-8d57-40b1-8708-5dd7aa05af9f req-270a021c-e7a2-4a6d-b240-1e42d62f1b2e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106463 Aug 05 20:18:24.063246 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 648/1277] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:18:24.069980 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-fc70fc73-0f6e-4efd-a2d9-9f5e4631b93d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:18:24.070587 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-fc70fc73-0f6e-4efd-a2d9-9f5e4631b93d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:18:24.078195 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc70fc73-0f6e-4efd-a2d9-9f5e4631b93d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:24.078800 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc70fc73-0f6e-4efd-a2d9-9f5e4631b93d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:24.079282 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc70fc73-0f6e-4efd-a2d9-9f5e4631b93d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:24.079992 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc70fc73-0f6e-4efd-a2d9-9f5e4631b93d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:24.080447 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc70fc73-0f6e-4efd-a2d9-9f5e4631b93d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:24.080912 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-fc70fc73-0f6e-4efd-a2d9-9f5e4631b93d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:24.146420 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-fc70fc73-0f6e-4efd-a2d9-9f5e4631b93d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:18:24.154449 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-fc70fc73-0f6e-4efd-a2d9-9f5e4631b93d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 200 len: 1225 microversion: 2.1 time: 0.088532 Aug 05 20:18:24.155022 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 630/1278] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:18:24 2022] GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:18:25.177480 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b5b6b1f6-76d9-4f12-aea9-14c62ffc677d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:18:25.178193 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-b5b6b1f6-76d9-4f12-aea9-14c62ffc677d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: f346a0be-3cbc-4049-b079-576f8c9196be] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:18:25.184413 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5b6b1f6-76d9-4f12-aea9-14c62ffc677d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:25.184936 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5b6b1f6-76d9-4f12-aea9-14c62ffc677d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:25.185382 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5b6b1f6-76d9-4f12-aea9-14c62ffc677d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:25.186086 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5b6b1f6-76d9-4f12-aea9-14c62ffc677d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:25.186583 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5b6b1f6-76d9-4f12-aea9-14c62ffc677d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:25.187013 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5b6b1f6-76d9-4f12-aea9-14c62ffc677d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:25.203774 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-b5b6b1f6-76d9-4f12-aea9-14c62ffc677d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] HTTP exception thrown: Instance f346a0be-3cbc-4049-b079-576f8c9196be could not be found. Aug 05 20:18:25.205689 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b5b6b1f6-76d9-4f12-aea9-14c62ffc677d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Request method failure captured: Aug 05 20:18:25.205689 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be HTTP/1.1 Aug 05 20:18:25.205689 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:18:25.205689 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:18:25.205689 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:18:25.205689 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 0 Aug 05 20:18:25.205689 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:18:25.205689 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:18:25.205689 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:18:25.205689 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:18:25.205689 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XjnN_K-BJc2ooeeA-GjFUZkpe01X2HFLfu4EeNixYoYlQKGhG1Ga_z_gX6AtTffhAVBCBlFM69Bn_lW3GgYTXZVm-uCbgbvM9WIRToIJCUeCq_7gVk8CLPH9jnqkZHCqKZPxnNJ_CXAPAme_CWDTdR8C7T6XJiNHdI-Yr5p4VgPxFY Aug 05 20:18:25.205689 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:18:25.205689 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:18:25.205689 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:18:25.205689 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:18:25.205689 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:18:25.205689 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:18:25.205689 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: cd1707d3a6c640b78baeb522cfb7ecdb Aug 05 20:18:25.205689 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-TestVolumeBootPattern-1587761633 Aug 05 20:18:25.205689 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:18:25.205689 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:18:25.207343 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cd1707d3a6c640b78baeb522cfb7ecdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cd1707d3a6c640b78baeb522cfb7ecdb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cd1707d3a6c640b78baeb522cfb7ecdb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cd1707d3a6c640b78baeb522cfb7ecdb", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:18:25.207343 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-TestVolumeBootPattern-1587761633 Aug 05 20:18:25.207343 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: cd1707d3a6c640b78baeb522cfb7ecdb Aug 05 20:18:25.207343 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-TestVolumeBootPattern-1587761633 Aug 05 20:18:25.207343 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-TestVolumeBootPattern-1587761633-project Aug 05 20:18:25.207343 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:18:25.207343 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:18:25.207343 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: b5d959f3af3745ed8e0bc4a67faf34f1 Aug 05 20:18:25.207343 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-TestVolumeBootPattern-1587761633-project Aug 05 20:18:25.207343 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: > Aug 05 20:18:25.207343 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Instance f346a0be-3cbc-4049-b079-576f8c9196be could not be found. Aug 05 20:18:25.207343 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'id': 'f346a0be-3cbc-4049-b079-576f8c9196be'} Aug 05 20:18:25.208250 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:18:25.208250 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:18:25.208250 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:18:25.208250 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:18:25.208250 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:18:25.208250 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:18:25.208250 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:18:25.208250 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:18:25.208250 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:18:25.208250 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:18:25.208250 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f346a0be-3cbc-4049-b079-576f8c9196be could not be found. Aug 05 20:18:25.208250 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:18:25.208250 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:18:25.208250 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:18:25.208250 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:18:25.208250 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:18:25.208250 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:18:25.208250 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:18:25.208250 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:18:25.208250 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:18:25.210665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:18:25.210665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:18:25.210665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:18:25.210665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:18:25.210665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:18:25.210665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:18:25.210665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:18:25.210665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f346a0be-3cbc-4049-b079-576f8c9196be could not be found. Aug 05 20:18:25.210665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:18:25.210665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:18:25.210665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:18:25.210665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:18:25.210665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:18:25.210665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:18:25.210665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:18:25.210665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:18:25.210665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f346a0be-3cbc-4049-b079-576f8c9196be could not be found. Aug 05 20:18:25.210665 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:18:25.212309 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b5b6b1f6-76d9-4f12-aea9-14c62ffc677d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Returning 404 to user: Instance f346a0be-3cbc-4049-b079-576f8c9196be could not be found. {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:18:25.212309 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b5b6b1f6-76d9-4f12-aea9-14c62ffc677d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be" status: 404 len: 111 microversion: 2.1 time: 0.034459 Aug 05 20:18:25.212309 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 649/1279] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:18:25 2022] GET /compute/v2.1/servers/f346a0be-3cbc-4049-b079-576f8c9196be => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:18:28.320748 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-b6d1a308-0f41-4fa4-bef1-be37cf8e993a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:18:28.321952 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-b6d1a308-0f41-4fa4-bef1-be37cf8e993a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: d7407cff-913f-4141-9f0a-619b0e5b0b05] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:18:28.327271 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-c96e5393-4982-411f-ad78-3fc642b73f69 req-b9d0dfc3-9b99-48b8-8625-0dae69ea1d4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7407cff-913f-4141-9f0a-619b0e5b0b05", "tag": "e2770287-7121-4b5f-adab-ca922bed34c8"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:18:28.330336 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b6d1a308-0f41-4fa4-bef1-be37cf8e993a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:28.331164 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b6d1a308-0f41-4fa4-bef1-be37cf8e993a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:28.331813 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b6d1a308-0f41-4fa4-bef1-be37cf8e993a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:28.332557 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b6d1a308-0f41-4fa4-bef1-be37cf8e993a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:28.333056 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b6d1a308-0f41-4fa4-bef1-be37cf8e993a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:28.333643 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-b6d1a308-0f41-4fa4-bef1-be37cf8e993a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:28.338068 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-c96e5393-4982-411f-ad78-3fc642b73f69 req-b9d0dfc3-9b99-48b8-8625-0dae69ea1d4a service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:28.338558 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-c96e5393-4982-411f-ad78-3fc642b73f69 req-b9d0dfc3-9b99-48b8-8625-0dae69ea1d4a service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:28.338996 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-c96e5393-4982-411f-ad78-3fc642b73f69 req-b9d0dfc3-9b99-48b8-8625-0dae69ea1d4a service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:28.355869 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-c96e5393-4982-411f-ad78-3fc642b73f69 req-b9d0dfc3-9b99-48b8-8625-0dae69ea1d4a service nova] Creating event network-changed:e2770287-7121-4b5f-adab-ca922bed34c8 for instance d7407cff-913f-4141-9f0a-619b0e5b0b05 on hv-cinder-85221 Aug 05 20:18:28.362410 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-c96e5393-4982-411f-ad78-3fc642b73f69 req-b9d0dfc3-9b99-48b8-8625-0dae69ea1d4a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038883 Aug 05 20:18:28.363138 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 650/1280] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:18:28.366885 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-b6d1a308-0f41-4fa4-bef1-be37cf8e993a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: d7407cff-913f-4141-9f0a-619b0e5b0b05] Going to try to terminate instance {{(pid=118191) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:18:28.467707 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-b6d1a308-0f41-4fa4-bef1-be37cf8e993a tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05" status: 204 len: 0 microversion: 2.1 time: 0.150063 Aug 05 20:18:28.471696 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 631/1281] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:18:28 2022] DELETE /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:18:28.484923 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-738636f3-097b-47e6-9b67-dcf0ecdf0101 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:18:28.486258 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-738636f3-097b-47e6-9b67-dcf0ecdf0101 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: d7407cff-913f-4141-9f0a-619b0e5b0b05] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:18:28.498134 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-738636f3-097b-47e6-9b67-dcf0ecdf0101 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:28.499048 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-738636f3-097b-47e6-9b67-dcf0ecdf0101 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:28.500186 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-738636f3-097b-47e6-9b67-dcf0ecdf0101 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:28.501718 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-738636f3-097b-47e6-9b67-dcf0ecdf0101 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:28.502492 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-738636f3-097b-47e6-9b67-dcf0ecdf0101 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:28.503228 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-738636f3-097b-47e6-9b67-dcf0ecdf0101 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:28.757941 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-738636f3-097b-47e6-9b67-dcf0ecdf0101 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:18:28.767943 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-738636f3-097b-47e6-9b67-dcf0ecdf0101 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05" status: 200 len: 1576 microversion: 2.1 time: 0.290529 Aug 05 20:18:28.768563 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 651/1282] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:18:28 2022] GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05 => generated 1576 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:18:29.790391 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-5548090b-00fe-45a8-8d95-60d3119bf997 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:18:29.791215 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-5548090b-00fe-45a8-8d95-60d3119bf997 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: d7407cff-913f-4141-9f0a-619b0e5b0b05] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:18:29.798825 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5548090b-00fe-45a8-8d95-60d3119bf997 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:29.799324 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5548090b-00fe-45a8-8d95-60d3119bf997 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:29.799767 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5548090b-00fe-45a8-8d95-60d3119bf997 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:29.800476 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5548090b-00fe-45a8-8d95-60d3119bf997 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:29.800972 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5548090b-00fe-45a8-8d95-60d3119bf997 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:29.801397 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5548090b-00fe-45a8-8d95-60d3119bf997 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:30.028656 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-5548090b-00fe-45a8-8d95-60d3119bf997 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d959f3af3745ed8e0bc4a67faf34f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1707d3a6c640b78baeb522cfb7ecdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:18:30.037600 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-5548090b-00fe-45a8-8d95-60d3119bf997 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05" status: 200 len: 1458 microversion: 2.1 time: 0.252012 Aug 05 20:18:30.038189 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 632/1283] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:18:29 2022] GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05 => generated 1458 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:18:30.379064 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-e22b2343-9eb1-4f1a-8e9e-9450f50dc393 req-ce5abe3c-afab-4ea9-8f07-9e06ed2f851d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7407cff-913f-4141-9f0a-619b0e5b0b05", "name": "network-vif-deleted", "tag": "e2770287-7121-4b5f-adab-ca922bed34c8"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:18:30.389670 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-e22b2343-9eb1-4f1a-8e9e-9450f50dc393 req-ce5abe3c-afab-4ea9-8f07-9e06ed2f851d service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:30.390301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-e22b2343-9eb1-4f1a-8e9e-9450f50dc393 req-ce5abe3c-afab-4ea9-8f07-9e06ed2f851d service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:30.391719 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-e22b2343-9eb1-4f1a-8e9e-9450f50dc393 req-ce5abe3c-afab-4ea9-8f07-9e06ed2f851d service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:30.406268 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-e22b2343-9eb1-4f1a-8e9e-9450f50dc393 req-ce5abe3c-afab-4ea9-8f07-9e06ed2f851d service nova] Creating event network-vif-deleted:e2770287-7121-4b5f-adab-ca922bed34c8 for instance d7407cff-913f-4141-9f0a-619b0e5b0b05 on hv-cinder-85221 Aug 05 20:18:30.411750 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-e22b2343-9eb1-4f1a-8e9e-9450f50dc393 req-ce5abe3c-afab-4ea9-8f07-9e06ed2f851d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036845 Aug 05 20:18:30.412810 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 652/1284] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:18:31.063895 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-0cfd6a1c-8612-45ea-8181-9f4fe2c788f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:18:31.064911 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-0cfd6a1c-8612-45ea-8181-9f4fe2c788f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: d7407cff-913f-4141-9f0a-619b0e5b0b05] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:18:31.076079 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0cfd6a1c-8612-45ea-8181-9f4fe2c788f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:31.076993 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0cfd6a1c-8612-45ea-8181-9f4fe2c788f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:31.077776 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0cfd6a1c-8612-45ea-8181-9f4fe2c788f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:31.079089 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0cfd6a1c-8612-45ea-8181-9f4fe2c788f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:31.079986 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0cfd6a1c-8612-45ea-8181-9f4fe2c788f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:31.080748 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0cfd6a1c-8612-45ea-8181-9f4fe2c788f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:31.109074 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-0cfd6a1c-8612-45ea-8181-9f4fe2c788f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] HTTP exception thrown: Instance d7407cff-913f-4141-9f0a-619b0e5b0b05 could not be found. Aug 05 20:18:31.111882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-0cfd6a1c-8612-45ea-8181-9f4fe2c788f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Request method failure captured: Aug 05 20:18:31.111882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05 HTTP/1.1 Aug 05 20:18:31.111882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:18:31.111882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:18:31.111882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:18:31.111882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:18:31.111882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:18:31.111882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:18:31.111882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:18:31.111882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:18:31.111882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XjnN_K-BJc2ooeeA-GjFUZkpe01X2HFLfu4EeNixYoYlQKGhG1Ga_z_gX6AtTffhAVBCBlFM69Bn_lW3GgYTXZVm-uCbgbvM9WIRToIJCUeCq_7gVk8CLPH9jnqkZHCqKZPxnNJ_CXAPAme_CWDTdR8C7T6XJiNHdI-Yr5p4VgPxFY Aug 05 20:18:31.111882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:18:31.111882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:18:31.111882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:18:31.111882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:18:31.111882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:18:31.111882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:18:31.111882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: cd1707d3a6c640b78baeb522cfb7ecdb Aug 05 20:18:31.111882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-TestVolumeBootPattern-1587761633 Aug 05 20:18:31.111882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:18:31.111882 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:18:31.114632 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cd1707d3a6c640b78baeb522cfb7ecdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cd1707d3a6c640b78baeb522cfb7ecdb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cd1707d3a6c640b78baeb522cfb7ecdb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cd1707d3a6c640b78baeb522cfb7ecdb", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:18:31.114632 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-TestVolumeBootPattern-1587761633 Aug 05 20:18:31.114632 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: cd1707d3a6c640b78baeb522cfb7ecdb Aug 05 20:18:31.114632 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-TestVolumeBootPattern-1587761633 Aug 05 20:18:31.114632 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-TestVolumeBootPattern-1587761633-project Aug 05 20:18:31.114632 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:18:31.114632 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:18:31.114632 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: b5d959f3af3745ed8e0bc4a67faf34f1 Aug 05 20:18:31.114632 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-TestVolumeBootPattern-1587761633-project Aug 05 20:18:31.114632 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: > Aug 05 20:18:31.114632 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Instance d7407cff-913f-4141-9f0a-619b0e5b0b05 could not be found. Aug 05 20:18:31.114632 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'id': 'd7407cff-913f-4141-9f0a-619b0e5b0b05'} Aug 05 20:18:31.116304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:18:31.116304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:18:31.116304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:18:31.116304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:18:31.116304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:18:31.116304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:18:31.116304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:18:31.116304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:18:31.116304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:18:31.116304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:18:31.116304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7407cff-913f-4141-9f0a-619b0e5b0b05 could not be found. Aug 05 20:18:31.116304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:18:31.116304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:18:31.116304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:18:31.116304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:18:31.116304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:18:31.116304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:18:31.116304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:18:31.116304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:18:31.116304 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:18:31.118737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:18:31.118737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:18:31.118737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:18:31.118737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:18:31.118737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:18:31.118737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:18:31.118737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:18:31.118737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7407cff-913f-4141-9f0a-619b0e5b0b05 could not be found. Aug 05 20:18:31.118737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:18:31.118737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:18:31.118737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:18:31.118737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:18:31.118737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:18:31.118737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:18:31.118737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:18:31.118737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:18:31.118737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7407cff-913f-4141-9f0a-619b0e5b0b05 could not be found. Aug 05 20:18:31.118737 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:18:31.121209 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-0cfd6a1c-8612-45ea-8181-9f4fe2c788f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Returning 404 to user: Instance d7407cff-913f-4141-9f0a-619b0e5b0b05 could not be found. {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:18:31.121209 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-0cfd6a1c-8612-45ea-8181-9f4fe2c788f9 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05" status: 404 len: 111 microversion: 2.1 time: 0.057529 Aug 05 20:18:31.121209 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 633/1285] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:18:31 2022] GET /compute/v2.1/servers/d7407cff-913f-4141-9f0a-619b0e5b0b05 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:18:31.943607 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ea25659f-832a-40cd-91bb-23f982bbe1cb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:18:31.944275 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-ea25659f-832a-40cd-91bb-23f982bbe1cb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:18:31.951271 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ea25659f-832a-40cd-91bb-23f982bbe1cb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:31.951780 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ea25659f-832a-40cd-91bb-23f982bbe1cb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:31.952221 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ea25659f-832a-40cd-91bb-23f982bbe1cb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:31.952992 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ea25659f-832a-40cd-91bb-23f982bbe1cb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:31.953925 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ea25659f-832a-40cd-91bb-23f982bbe1cb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:31.954285 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-ea25659f-832a-40cd-91bb-23f982bbe1cb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:31.969986 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-ea25659f-832a-40cd-91bb-23f982bbe1cb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] HTTP exception thrown: Instance 412b5860-2133-41f8-8960-b3f068a8f11f could not be found. Aug 05 20:18:31.971697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ea25659f-832a-40cd-91bb-23f982bbe1cb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Request method failure captured: Aug 05 20:18:31.971697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: DELETE /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f HTTP/1.1 Aug 05 20:18:31.971697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:18:31.971697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:18:31.971697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:18:31.971697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 0 Aug 05 20:18:31.971697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:18:31.971697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:18:31.971697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:18:31.971697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:18:31.971697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XjnN_K-BJc2ooeeA-GjFUZkpe01X2HFLfu4EeNixYoYlQKGhG1Ga_z_gX6AtTffhAVBCBlFM69Bn_lW3GgYTXZVm-uCbgbvM9WIRToIJCUeCq_7gVk8CLPH9jnqkZHCqKZPxnNJ_CXAPAme_CWDTdR8C7T6XJiNHdI-Yr5p4VgPxFY Aug 05 20:18:31.971697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:18:31.971697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:18:31.971697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:18:31.971697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:18:31.971697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:18:31.971697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:18:31.971697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: cd1707d3a6c640b78baeb522cfb7ecdb Aug 05 20:18:31.971697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-TestVolumeBootPattern-1587761633 Aug 05 20:18:31.971697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:18:31.971697 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:18:31.974406 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cd1707d3a6c640b78baeb522cfb7ecdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cd1707d3a6c640b78baeb522cfb7ecdb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cd1707d3a6c640b78baeb522cfb7ecdb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cd1707d3a6c640b78baeb522cfb7ecdb", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:18:31.974406 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-TestVolumeBootPattern-1587761633 Aug 05 20:18:31.974406 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: cd1707d3a6c640b78baeb522cfb7ecdb Aug 05 20:18:31.974406 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-TestVolumeBootPattern-1587761633 Aug 05 20:18:31.974406 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-TestVolumeBootPattern-1587761633-project Aug 05 20:18:31.974406 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:18:31.974406 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:18:31.974406 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: b5d959f3af3745ed8e0bc4a67faf34f1 Aug 05 20:18:31.974406 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-TestVolumeBootPattern-1587761633-project Aug 05 20:18:31.974406 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: > Aug 05 20:18:31.974406 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Instance 412b5860-2133-41f8-8960-b3f068a8f11f could not be found. Aug 05 20:18:31.974406 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'id': '412b5860-2133-41f8-8960-b3f068a8f11f'} Aug 05 20:18:31.976260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:18:31.976260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:18:31.976260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:18:31.976260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:18:31.976260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:18:31.976260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:18:31.976260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:18:31.976260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:18:31.976260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:18:31.976260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:18:31.976260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 412b5860-2133-41f8-8960-b3f068a8f11f could not be found. Aug 05 20:18:31.976260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:18:31.976260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:18:31.976260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:18:31.976260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:18:31.976260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:18:31.976260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:18:31.976260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:18:31.976260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:18:31.976260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:18:31.979408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:18:31.979408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:18:31.979408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:18:31.979408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:18:31.979408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:18:31.979408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:18:31.979408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:18:31.979408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:18:31.979408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:18:31.979408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 412b5860-2133-41f8-8960-b3f068a8f11f could not be found. Aug 05 20:18:31.979408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:18:31.979408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:18:31.979408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:18:31.979408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:18:31.979408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:18:31.979408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:18:31.979408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:18:31.979408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:18:31.979408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 412b5860-2133-41f8-8960-b3f068a8f11f could not be found. Aug 05 20:18:31.979408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:18:31.982557 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-ea25659f-832a-40cd-91bb-23f982bbe1cb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Returning 404 to user: Instance 412b5860-2133-41f8-8960-b3f068a8f11f could not be found. {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:18:31.982557 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-ea25659f-832a-40cd-91bb-23f982bbe1cb tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "DELETE /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 404 len: 111 microversion: 2.1 time: 0.034490 Aug 05 20:18:31.982557 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 653/1286] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:18:31 2022] DELETE /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 20:18:31.993461 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7f30d032-a9c3-4753-9fcc-84a6f6cb366d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:18:31.994641 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-7f30d032-a9c3-4753-9fcc-84a6f6cb366d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] [instance: 412b5860-2133-41f8-8960-b3f068a8f11f] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:18:32.006223 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7f30d032-a9c3-4753-9fcc-84a6f6cb366d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:32.007125 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7f30d032-a9c3-4753-9fcc-84a6f6cb366d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:32.007924 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7f30d032-a9c3-4753-9fcc-84a6f6cb366d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:32.009254 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7f30d032-a9c3-4753-9fcc-84a6f6cb366d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:32.010100 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7f30d032-a9c3-4753-9fcc-84a6f6cb366d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:32.010887 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7f30d032-a9c3-4753-9fcc-84a6f6cb366d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:32.034826 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-7f30d032-a9c3-4753-9fcc-84a6f6cb366d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] HTTP exception thrown: Instance 412b5860-2133-41f8-8960-b3f068a8f11f could not be found. Aug 05 20:18:32.036724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7f30d032-a9c3-4753-9fcc-84a6f6cb366d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Request method failure captured: Aug 05 20:18:32.036724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f HTTP/1.1 Aug 05 20:18:32.036724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:18:32.036724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:18:32.036724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:18:32.036724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:18:32.036724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:18:32.036724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:18:32.036724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:18:32.036724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:18:32.036724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XjnN_K-BJc2ooeeA-GjFUZkpe01X2HFLfu4EeNixYoYlQKGhG1Ga_z_gX6AtTffhAVBCBlFM69Bn_lW3GgYTXZVm-uCbgbvM9WIRToIJCUeCq_7gVk8CLPH9jnqkZHCqKZPxnNJ_CXAPAme_CWDTdR8C7T6XJiNHdI-Yr5p4VgPxFY Aug 05 20:18:32.036724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:18:32.036724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:18:32.036724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:18:32.036724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:18:32.036724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:18:32.036724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:18:32.036724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: cd1707d3a6c640b78baeb522cfb7ecdb Aug 05 20:18:32.036724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-TestVolumeBootPattern-1587761633 Aug 05 20:18:32.036724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:18:32.036724 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:18:32.038548 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cd1707d3a6c640b78baeb522cfb7ecdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cd1707d3a6c640b78baeb522cfb7ecdb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cd1707d3a6c640b78baeb522cfb7ecdb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cd1707d3a6c640b78baeb522cfb7ecdb", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:18:32.038548 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-TestVolumeBootPattern-1587761633 Aug 05 20:18:32.038548 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: cd1707d3a6c640b78baeb522cfb7ecdb Aug 05 20:18:32.038548 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-TestVolumeBootPattern-1587761633 Aug 05 20:18:32.038548 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-TestVolumeBootPattern-1587761633-project Aug 05 20:18:32.038548 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:18:32.038548 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:18:32.038548 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: b5d959f3af3745ed8e0bc4a67faf34f1 Aug 05 20:18:32.038548 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-TestVolumeBootPattern-1587761633-project Aug 05 20:18:32.038548 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: > Aug 05 20:18:32.038548 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Instance 412b5860-2133-41f8-8960-b3f068a8f11f could not be found. Aug 05 20:18:32.038548 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'id': '412b5860-2133-41f8-8960-b3f068a8f11f'} Aug 05 20:18:32.039566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:18:32.039566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:18:32.039566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:18:32.039566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:18:32.039566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:18:32.039566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:18:32.039566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:18:32.039566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:18:32.039566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:18:32.039566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:18:32.039566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 412b5860-2133-41f8-8960-b3f068a8f11f could not be found. Aug 05 20:18:32.039566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:18:32.039566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:18:32.039566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:18:32.039566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:18:32.039566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:18:32.039566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:18:32.039566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:18:32.039566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:18:32.039566 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:18:32.041246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:18:32.041246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:18:32.041246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:18:32.041246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:18:32.041246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:18:32.041246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:18:32.041246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:18:32.041246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 412b5860-2133-41f8-8960-b3f068a8f11f could not be found. Aug 05 20:18:32.041246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:18:32.041246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:18:32.041246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:18:32.041246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:18:32.041246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:18:32.041246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:18:32.041246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:18:32.041246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:18:32.041246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 412b5860-2133-41f8-8960-b3f068a8f11f could not be found. Aug 05 20:18:32.041246 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:18:32.042788 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7f30d032-a9c3-4753-9fcc-84a6f6cb366d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Returning 404 to user: Instance 412b5860-2133-41f8-8960-b3f068a8f11f could not be found. {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:18:32.042788 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-7f30d032-a9c3-4753-9fcc-84a6f6cb366d tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f" status: 404 len: 111 microversion: 2.1 time: 0.052833 Aug 05 20:18:32.042788 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 634/1287] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:18:31 2022] GET /compute/v2.1/servers/412b5860-2133-41f8-8960-b3f068a8f11f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:18:33.386042 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-e3758f26-3dbb-48df-ae56-67c4ed289f43 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] Calling method '.version_select at 0x7fe3e46b64c0>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:18:33.411226 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-e3758f26-3dbb-48df-ae56-67c4ed289f43 tempest-TestVolumeBootPattern-1587761633 tempest-TestVolumeBootPattern-1587761633-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1158990661" status: 202 len: 0 microversion: 2.1 time: 0.028999 Aug 05 20:18:33.411991 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 654/1288] 10.222.0.39 () {58 vars in 1263 bytes} [Fri Aug 5 20:18:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1158990661 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:18:48.554654 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-783c65be-eee7-4a88-9167-868f2231f1f5 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:18:48.555223 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-783c65be-eee7-4a88-9167-868f2231f1f5 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:18:48.557399 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=2 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:18:48.558053 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:18:48.565603 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-783c65be-eee7-4a88-9167-868f2231f1f5 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:48.566114 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-783c65be-eee7-4a88-9167-868f2231f1f5 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:48.566540 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-783c65be-eee7-4a88-9167-868f2231f1f5 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:48.567250 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-783c65be-eee7-4a88-9167-868f2231f1f5 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:48.567708 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-783c65be-eee7-4a88-9167-868f2231f1f5 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:48.568139 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-783c65be-eee7-4a88-9167-868f2231f1f5 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:48.595044 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-783c65be-eee7-4a88-9167-868f2231f1f5 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7/ips" status: 200 len: 146 microversion: 2.1 time: 0.044180 Aug 05 20:18:48.595637 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 635/1289] 10.222.0.39 () {58 vars in 1248 bytes} [Fri Aug 5 20:18:48 2022] GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7/ips => generated 146 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:18:49.975246 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-cb9105da-b9b4-4113-80f3-3fa1ef16bb2e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a520928-3c7c-4ee6-ad18-a78c2c778780"}} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:18:49.977607 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-cb9105da-b9b4-4113-80f3-3fa1ef16bb2e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:18:49.981026 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=24 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:18:49.981679 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:18:49.988680 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cb9105da-b9b4-4113-80f3-3fa1ef16bb2e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:49.989176 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cb9105da-b9b4-4113-80f3-3fa1ef16bb2e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:49.989626 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cb9105da-b9b4-4113-80f3-3fa1ef16bb2e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:49.990344 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cb9105da-b9b4-4113-80f3-3fa1ef16bb2e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:49.990803 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cb9105da-b9b4-4113-80f3-3fa1ef16bb2e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:49.991238 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-cb9105da-b9b4-4113-80f3-3fa1ef16bb2e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:50.272449 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-cb9105da-b9b4-4113-80f3-3fa1ef16bb2e tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "POST /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300774 Aug 05 20:18:50.273053 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 655/1290] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Aug 5 20:18:49 2022] POST /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:18:57.870380 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f94216e9-fc8c-4fbf-bc99-61af6b50d288 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:18:57.872563 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f94216e9-fc8c-4fbf-bc99-61af6b50d288 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:18:57.881034 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f94216e9-fc8c-4fbf-bc99-61af6b50d288 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:57.881525 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f94216e9-fc8c-4fbf-bc99-61af6b50d288 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:57.881965 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f94216e9-fc8c-4fbf-bc99-61af6b50d288 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:57.882674 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f94216e9-fc8c-4fbf-bc99-61af6b50d288 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:57.883127 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f94216e9-fc8c-4fbf-bc99-61af6b50d288 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:57.883557 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f94216e9-fc8c-4fbf-bc99-61af6b50d288 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:57.918996 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f94216e9-fc8c-4fbf-bc99-61af6b50d288 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052835 Aug 05 20:18:57.919590 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 636/1291] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Aug 5 20:18:57 2022] GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:18:57.931341 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-81311ebc-257d-41bf-a9d4-18ff6f830f99 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:18:57.932212 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-81311ebc-257d-41bf-a9d4-18ff6f830f99 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:18:57.939382 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-81311ebc-257d-41bf-a9d4-18ff6f830f99 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:57.939872 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-81311ebc-257d-41bf-a9d4-18ff6f830f99 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:57.940678 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-81311ebc-257d-41bf-a9d4-18ff6f830f99 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:57.941155 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-81311ebc-257d-41bf-a9d4-18ff6f830f99 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:57.941601 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-81311ebc-257d-41bf-a9d4-18ff6f830f99 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:57.942027 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-81311ebc-257d-41bf-a9d4-18ff6f830f99 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:57.972706 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-81311ebc-257d-41bf-a9d4-18ff6f830f99 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7/os-volume_attachments/8a520928-3c7c-4ee6-ad18-a78c2c778780" status: 200 len: 194 microversion: 2.1 time: 0.046096 Aug 05 20:18:57.973307 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 656/1292] 10.222.0.39 () {58 vars in 1413 bytes} [Fri Aug 5 20:18:57 2022] GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7/os-volume_attachments/8a520928-3c7c-4ee6-ad18-a78c2c778780 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:18:59.354072 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-5e1899cb-3bbe-4749-a9f1-de4cc685a29c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "592ea1af-e2a2-4a96-94c9-a5931d950fc1"}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:18:59.356809 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-5e1899cb-3bbe-4749-a9f1-de4cc685a29c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:18:59.363723 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5e1899cb-3bbe-4749-a9f1-de4cc685a29c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:59.364205 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5e1899cb-3bbe-4749-a9f1-de4cc685a29c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:59.364656 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5e1899cb-3bbe-4749-a9f1-de4cc685a29c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:59.365356 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5e1899cb-3bbe-4749-a9f1-de4cc685a29c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:18:59.365806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5e1899cb-3bbe-4749-a9f1-de4cc685a29c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:18:59.366227 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-5e1899cb-3bbe-4749-a9f1-de4cc685a29c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:18:59.664865 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-5e1899cb-3bbe-4749-a9f1-de4cc685a29c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "POST /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314499 Aug 05 20:18:59.665450 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 637/1293] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Aug 5 20:18:59 2022] POST /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:19:07.263962 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-f632d82b-37a9-4184-8dc8-ae2cf58c9dd5 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:19:07.266527 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-f632d82b-37a9-4184-8dc8-ae2cf58c9dd5 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:19:07.273736 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f632d82b-37a9-4184-8dc8-ae2cf58c9dd5 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:07.274644 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f632d82b-37a9-4184-8dc8-ae2cf58c9dd5 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:07.274644 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f632d82b-37a9-4184-8dc8-ae2cf58c9dd5 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:07.276908 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f632d82b-37a9-4184-8dc8-ae2cf58c9dd5 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:07.276908 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f632d82b-37a9-4184-8dc8-ae2cf58c9dd5 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:07.276908 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-f632d82b-37a9-4184-8dc8-ae2cf58c9dd5 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:07.309319 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-f632d82b-37a9-4184-8dc8-ae2cf58c9dd5 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049356 Aug 05 20:19:07.309923 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 657/1294] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Aug 5 20:19:07 2022] GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:19:07.455806 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3fbc8a10-3b51-408d-b6ef-38dfa0eb71eb tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:19:07.456392 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-3fbc8a10-3b51-408d-b6ef-38dfa0eb71eb tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:19:07.462702 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3fbc8a10-3b51-408d-b6ef-38dfa0eb71eb tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:07.463202 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3fbc8a10-3b51-408d-b6ef-38dfa0eb71eb tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:07.463643 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3fbc8a10-3b51-408d-b6ef-38dfa0eb71eb tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:07.464362 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3fbc8a10-3b51-408d-b6ef-38dfa0eb71eb tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:07.464852 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3fbc8a10-3b51-408d-b6ef-38dfa0eb71eb tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:07.465280 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3fbc8a10-3b51-408d-b6ef-38dfa0eb71eb tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:07.499622 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3fbc8a10-3b51-408d-b6ef-38dfa0eb71eb tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7/os-volume_attachments/8a520928-3c7c-4ee6-ad18-a78c2c778780" status: 200 len: 194 microversion: 2.1 time: 0.049875 Aug 05 20:19:07.500233 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 638/1295] 10.222.0.39 () {58 vars in 1413 bytes} [Fri Aug 5 20:19:07 2022] GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7/os-volume_attachments/8a520928-3c7c-4ee6-ad18-a78c2c778780 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:19:07.511124 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-c9d8c691-82cc-41f8-90bd-a2e009f19b60 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:19:07.511631 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-c9d8c691-82cc-41f8-90bd-a2e009f19b60 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:19:07.522278 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c9d8c691-82cc-41f8-90bd-a2e009f19b60 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:07.523127 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c9d8c691-82cc-41f8-90bd-a2e009f19b60 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:07.523891 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c9d8c691-82cc-41f8-90bd-a2e009f19b60 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:07.525157 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c9d8c691-82cc-41f8-90bd-a2e009f19b60 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:07.525992 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c9d8c691-82cc-41f8-90bd-a2e009f19b60 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:07.526753 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c9d8c691-82cc-41f8-90bd-a2e009f19b60 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:07.630731 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.objects.instance [None req-c9d8c691-82cc-41f8-90bd-a2e009f19b60 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lazy-loading 'services' on Instance uuid 81bf9fdf-5b58-462f-9d79-4405217fcdf7 {{(pid=118192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:19:07.728365 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-c9d8c691-82cc-41f8-90bd-a2e009f19b60 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "DELETE /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7/os-volume_attachments/8a520928-3c7c-4ee6-ad18-a78c2c778780" status: 202 len: 0 microversion: 2.1 time: 0.221016 Aug 05 20:19:07.729179 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 658/1296] 10.222.0.39 () {58 vars in 1416 bytes} [Fri Aug 5 20:19:07 2022] DELETE /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7/os-volume_attachments/8a520928-3c7c-4ee6-ad18-a78c2c778780 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:19:09.981438 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-7aa1f120-a7d2-4a58-9752-28df61c94683 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:19:09.982228 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-7aa1f120-a7d2-4a58-9752-28df61c94683 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:19:09.991198 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7aa1f120-a7d2-4a58-9752-28df61c94683 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:09.991717 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7aa1f120-a7d2-4a58-9752-28df61c94683 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:09.992164 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7aa1f120-a7d2-4a58-9752-28df61c94683 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:09.992945 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7aa1f120-a7d2-4a58-9752-28df61c94683 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:09.993407 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7aa1f120-a7d2-4a58-9752-28df61c94683 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:09.993844 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-7aa1f120-a7d2-4a58-9752-28df61c94683 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:10.050605 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-7aa1f120-a7d2-4a58-9752-28df61c94683 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7/os-volume_attachments/592ea1af-e2a2-4a96-94c9-a5931d950fc1" status: 200 len: 194 microversion: 2.1 time: 0.072763 Aug 05 20:19:10.051717 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 639/1297] 10.222.0.39 () {58 vars in 1413 bytes} [Fri Aug 5 20:19:09 2022] GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7/os-volume_attachments/592ea1af-e2a2-4a96-94c9-a5931d950fc1 => generated 194 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:19:10.070306 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a721d5ba-5b3e-41ed-aefa-b9fb1d5b9257 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:19:10.071273 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a721d5ba-5b3e-41ed-aefa-b9fb1d5b9257 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:19:10.081547 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a721d5ba-5b3e-41ed-aefa-b9fb1d5b9257 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:10.082475 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a721d5ba-5b3e-41ed-aefa-b9fb1d5b9257 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:10.083305 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a721d5ba-5b3e-41ed-aefa-b9fb1d5b9257 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:10.084780 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a721d5ba-5b3e-41ed-aefa-b9fb1d5b9257 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:10.085630 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a721d5ba-5b3e-41ed-aefa-b9fb1d5b9257 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:10.086298 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a721d5ba-5b3e-41ed-aefa-b9fb1d5b9257 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:10.237938 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.objects.instance [None req-a721d5ba-5b3e-41ed-aefa-b9fb1d5b9257 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lazy-loading 'services' on Instance uuid 81bf9fdf-5b58-462f-9d79-4405217fcdf7 {{(pid=118192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:19:10.346741 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a721d5ba-5b3e-41ed-aefa-b9fb1d5b9257 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "DELETE /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7/os-volume_attachments/592ea1af-e2a2-4a96-94c9-a5931d950fc1" status: 202 len: 0 microversion: 2.1 time: 0.284174 Aug 05 20:19:10.347475 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 659/1298] 10.222.0.39 () {58 vars in 1416 bytes} [Fri Aug 5 20:19:10 2022] DELETE /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7/os-volume_attachments/592ea1af-e2a2-4a96-94c9-a5931d950fc1 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:19:11.578814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-74c13cf6-a6b6-4880-8315-ddc7ec5f380b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:19:11.581386 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-74c13cf6-a6b6-4880-8315-ddc7ec5f380b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:19:11.589870 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-74c13cf6-a6b6-4880-8315-ddc7ec5f380b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:11.589870 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-74c13cf6-a6b6-4880-8315-ddc7ec5f380b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:11.589870 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-74c13cf6-a6b6-4880-8315-ddc7ec5f380b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:11.590614 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-74c13cf6-a6b6-4880-8315-ddc7ec5f380b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:11.591115 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-74c13cf6-a6b6-4880-8315-ddc7ec5f380b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:11.591575 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-74c13cf6-a6b6-4880-8315-ddc7ec5f380b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:11.629502 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-74c13cf6-a6b6-4880-8315-ddc7ec5f380b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055214 Aug 05 20:19:11.630109 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 640/1299] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Aug 5 20:19:11 2022] GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:19:11.773596 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-8ee9b1d7-ba37-47c7-a198-954cb0f9d36b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:19:11.776197 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-8ee9b1d7-ba37-47c7-a198-954cb0f9d36b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:19:11.784947 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8ee9b1d7-ba37-47c7-a198-954cb0f9d36b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:11.785452 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8ee9b1d7-ba37-47c7-a198-954cb0f9d36b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:11.785895 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8ee9b1d7-ba37-47c7-a198-954cb0f9d36b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:11.786619 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8ee9b1d7-ba37-47c7-a198-954cb0f9d36b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:11.787096 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8ee9b1d7-ba37-47c7-a198-954cb0f9d36b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:11.787514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-8ee9b1d7-ba37-47c7-a198-954cb0f9d36b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:11.820020 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-8ee9b1d7-ba37-47c7-a198-954cb0f9d36b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051666 Aug 05 20:19:11.820621 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 660/1300] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Aug 5 20:19:11 2022] GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:19:11.901137 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-6a71d4c1-a088-4073-9c35-bcf8b68a2243 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:19:11.901730 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-6a71d4c1-a088-4073-9c35-bcf8b68a2243 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:19:11.909899 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6a71d4c1-a088-4073-9c35-bcf8b68a2243 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:11.910411 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6a71d4c1-a088-4073-9c35-bcf8b68a2243 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:11.910863 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6a71d4c1-a088-4073-9c35-bcf8b68a2243 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:11.911610 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6a71d4c1-a088-4073-9c35-bcf8b68a2243 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:11.912156 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6a71d4c1-a088-4073-9c35-bcf8b68a2243 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:11.912646 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-6a71d4c1-a088-4073-9c35-bcf8b68a2243 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:11.940308 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-6a71d4c1-a088-4073-9c35-bcf8b68a2243 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Going to try to terminate instance {{(pid=118191) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:19:12.044769 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-6a71d4c1-a088-4073-9c35-bcf8b68a2243 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "DELETE /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7" status: 204 len: 0 microversion: 2.1 time: 0.147695 Aug 05 20:19:12.045768 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 641/1301] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:19:11 2022] DELETE /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:19:12.054897 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-c60825b8-09ee-4cd2-8c6c-14abd9d3f72d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:19:12.055513 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-c60825b8-09ee-4cd2-8c6c-14abd9d3f72d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:19:12.061960 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c60825b8-09ee-4cd2-8c6c-14abd9d3f72d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:12.062529 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c60825b8-09ee-4cd2-8c6c-14abd9d3f72d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:12.063057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c60825b8-09ee-4cd2-8c6c-14abd9d3f72d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:12.063738 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c60825b8-09ee-4cd2-8c6c-14abd9d3f72d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:12.064140 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c60825b8-09ee-4cd2-8c6c-14abd9d3f72d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:12.064656 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-c60825b8-09ee-4cd2-8c6c-14abd9d3f72d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:12.237090 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-c60825b8-09ee-4cd2-8c6c-14abd9d3f72d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:19:12.245165 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-c60825b8-09ee-4cd2-8c6c-14abd9d3f72d tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7" status: 200 len: 1674 microversion: 2.1 time: 0.194887 Aug 05 20:19:12.245739 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 661/1302] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:19:12 2022] GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7 => generated 1674 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:19:13.269431 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-897be0d7-7558-4b3d-a255-d8a5edcace1c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:19:13.270238 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-897be0d7-7558-4b3d-a255-d8a5edcace1c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:19:13.282171 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-897be0d7-7558-4b3d-a255-d8a5edcace1c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:13.282678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-897be0d7-7558-4b3d-a255-d8a5edcace1c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:13.283125 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-897be0d7-7558-4b3d-a255-d8a5edcace1c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:13.283839 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-897be0d7-7558-4b3d-a255-d8a5edcace1c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:13.284291 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-897be0d7-7558-4b3d-a255-d8a5edcace1c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:13.284747 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-897be0d7-7558-4b3d-a255-d8a5edcace1c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:13.443623 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-897be0d7-7558-4b3d-a255-d8a5edcace1c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:19:13.452295 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-897be0d7-7558-4b3d-a255-d8a5edcace1c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7" status: 200 len: 1674 microversion: 2.1 time: 0.187323 Aug 05 20:19:13.453030 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 642/1303] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:19:13 2022] GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7 => generated 1674 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:19:14.479406 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-03f8e530-43fd-4411-9cee-1c14e6fb9c3a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:19:14.480467 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-03f8e530-43fd-4411-9cee-1c14e6fb9c3a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:19:14.492314 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-03f8e530-43fd-4411-9cee-1c14e6fb9c3a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:14.493227 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-03f8e530-43fd-4411-9cee-1c14e6fb9c3a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:14.494015 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-03f8e530-43fd-4411-9cee-1c14e6fb9c3a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:14.495258 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-03f8e530-43fd-4411-9cee-1c14e6fb9c3a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:14.496122 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-03f8e530-43fd-4411-9cee-1c14e6fb9c3a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:14.496930 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-03f8e530-43fd-4411-9cee-1c14e6fb9c3a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:14.765666 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-03f8e530-43fd-4411-9cee-1c14e6fb9c3a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:19:14.774332 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-03f8e530-43fd-4411-9cee-1c14e6fb9c3a tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7" status: 200 len: 1674 microversion: 2.1 time: 0.302226 Aug 05 20:19:14.774923 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 662/1304] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:19:14 2022] GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7 => generated 1674 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:19:15.328265 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [req-ece30c7a-84a9-402f-8c34-c746be405a22 req-dcf404c0-4116-43d9-90ed-5c592d0fe52e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81bf9fdf-5b58-462f-9d79-4405217fcdf7", "name": "network-vif-deleted", "tag": "b6f27fbd-9609-4402-8959-485aba416770"}]} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:19:15.339035 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-ece30c7a-84a9-402f-8c34-c746be405a22 req-dcf404c0-4116-43d9-90ed-5c592d0fe52e service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:15.339487 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-ece30c7a-84a9-402f-8c34-c746be405a22 req-dcf404c0-4116-43d9-90ed-5c592d0fe52e service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:15.339945 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [req-ece30c7a-84a9-402f-8c34-c746be405a22 req-dcf404c0-4116-43d9-90ed-5c592d0fe52e service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:15.352388 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.compute.server_external_events [req-ece30c7a-84a9-402f-8c34-c746be405a22 req-dcf404c0-4116-43d9-90ed-5c592d0fe52e service nova] Creating event network-vif-deleted:b6f27fbd-9609-4402-8959-485aba416770 for instance 81bf9fdf-5b58-462f-9d79-4405217fcdf7 on hv-cinder-85221 Aug 05 20:19:15.357456 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [req-ece30c7a-84a9-402f-8c34-c746be405a22 req-dcf404c0-4116-43d9-90ed-5c592d0fe52e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033312 Aug 05 20:19:15.361473 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 643/1305] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:19:15.798422 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-3fd32860-eaa4-472d-a4a1-4a4f647e053b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:19:15.798798 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-3fd32860-eaa4-472d-a4a1-4a4f647e053b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:19:15.805478 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3fd32860-eaa4-472d-a4a1-4a4f647e053b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:15.806026 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3fd32860-eaa4-472d-a4a1-4a4f647e053b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:15.806504 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3fd32860-eaa4-472d-a4a1-4a4f647e053b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:15.807494 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3fd32860-eaa4-472d-a4a1-4a4f647e053b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:15.808133 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3fd32860-eaa4-472d-a4a1-4a4f647e053b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:15.808566 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3fd32860-eaa4-472d-a4a1-4a4f647e053b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:15.854764 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3fd32860-eaa4-472d-a4a1-4a4f647e053b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:15.855647 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3fd32860-eaa4-472d-a4a1-4a4f647e053b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:15.856929 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-3fd32860-eaa4-472d-a4a1-4a4f647e053b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:15.857118 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.objects.instance [None req-3fd32860-eaa4-472d-a4a1-4a4f647e053b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lazy-loading 'fault' on Instance uuid 81bf9fdf-5b58-462f-9d79-4405217fcdf7 {{(pid=118192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:19:15.914172 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-3fd32860-eaa4-472d-a4a1-4a4f647e053b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305d1ce79a4f43c8b98e0967dab43da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790b5019b9114120a51718d99317f7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:19:15.923065 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-3fd32860-eaa4-472d-a4a1-4a4f647e053b tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7" status: 200 len: 1328 microversion: 2.1 time: 0.129241 Aug 05 20:19:15.927026 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 663/1306] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:19:15 2022] GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7 => generated 1328 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:19:16.956795 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a811ec54-203d-43e1-b74c-07607c16d41f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:19:16.957499 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-a811ec54-203d-43e1-b74c-07607c16d41f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:19:16.963662 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a811ec54-203d-43e1-b74c-07607c16d41f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:16.964148 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a811ec54-203d-43e1-b74c-07607c16d41f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:16.964604 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a811ec54-203d-43e1-b74c-07607c16d41f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:16.965299 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a811ec54-203d-43e1-b74c-07607c16d41f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:16.965783 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a811ec54-203d-43e1-b74c-07607c16d41f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:16.966213 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a811ec54-203d-43e1-b74c-07607c16d41f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:16.980754 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-a811ec54-203d-43e1-b74c-07607c16d41f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] HTTP exception thrown: Instance 81bf9fdf-5b58-462f-9d79-4405217fcdf7 could not be found. Aug 05 20:19:16.982409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a811ec54-203d-43e1-b74c-07607c16d41f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Request method failure captured: Aug 05 20:19:16.982409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7 HTTP/1.1 Aug 05 20:19:16.982409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:19:16.982409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:19:16.982409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:19:16.982409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:19:16.982409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:19:16.982409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:19:16.982409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:19:16.982409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:19:16.982409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XmXv3VSfnlBKrwyzZo0upQLfZZhWc1R88wTLpPYBPFzo6DADXU4k-ZUhjUkibgdBtjHtHw99mfvPe9gQl6pV5S3s-t-SLPCPYr6R4OC0c20T9hlbOUa_Ju24yHFLtRQagRitlbXqYyk7z2reWJraXuPNdu140ZeiR2I7Sg5-PBp5iI Aug 05 20:19:16.982409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:19:16.982409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:19:16.982409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:19:16.982409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:19:16.982409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:19:16.982409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:19:16.982409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: 790b5019b9114120a51718d99317f7a1 Aug 05 20:19:16.982409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-AttachVolumeTestJSON-1174647915 Aug 05 20:19:16.982409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:19:16.982409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:19:16.984930 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/790b5019b9114120a51718d99317f7a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/790b5019b9114120a51718d99317f7a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/790b5019b9114120a51718d99317f7a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_790b5019b9114120a51718d99317f7a1", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:19:16.984930 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-AttachVolumeTestJSON-1174647915 Aug 05 20:19:16.984930 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: 790b5019b9114120a51718d99317f7a1 Aug 05 20:19:16.984930 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1174647915 Aug 05 20:19:16.984930 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-AttachVolumeTestJSON-1174647915-project Aug 05 20:19:16.984930 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:19:16.984930 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:19:16.984930 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: 305d1ce79a4f43c8b98e0967dab43da1 Aug 05 20:19:16.984930 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-AttachVolumeTestJSON-1174647915-project Aug 05 20:19:16.984930 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: > Aug 05 20:19:16.984930 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Instance 81bf9fdf-5b58-462f-9d79-4405217fcdf7 could not be found. Aug 05 20:19:16.984930 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'id': '81bf9fdf-5b58-462f-9d79-4405217fcdf7'} Aug 05 20:19:16.985814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:19:16.985814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:19:16.985814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:19:16.985814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:19:16.985814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:19:16.985814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:19:16.985814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:19:16.985814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:19:16.985814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:19:16.985814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:19:16.985814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81bf9fdf-5b58-462f-9d79-4405217fcdf7 could not be found. Aug 05 20:19:16.985814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:19:16.985814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:19:16.985814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:19:16.985814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:19:16.985814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:19:16.985814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:19:16.985814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:19:16.985814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:19:16.985814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:19:16.987699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:19:16.987699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:19:16.987699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:19:16.987699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:19:16.987699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:19:16.987699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:19:16.987699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:19:16.987699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81bf9fdf-5b58-462f-9d79-4405217fcdf7 could not be found. Aug 05 20:19:16.987699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:19:16.987699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:19:16.987699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:19:16.987699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:19:16.987699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:19:16.987699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:19:16.987699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:19:16.987699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:19:16.987699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81bf9fdf-5b58-462f-9d79-4405217fcdf7 could not be found. Aug 05 20:19:16.987699 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:19:16.989719 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a811ec54-203d-43e1-b74c-07607c16d41f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Returning 404 to user: Instance 81bf9fdf-5b58-462f-9d79-4405217fcdf7 could not be found. {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:19:16.989719 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-a811ec54-203d-43e1-b74c-07607c16d41f tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7" status: 404 len: 111 microversion: 2.1 time: 0.034132 Aug 05 20:19:16.989719 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 644/1307] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:19:16 2022] GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:19:16.994159 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b6b45a52-e63f-40db-bd7b-87afafac22b7 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '.version_select at 0x7fe3e4805820>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:19:17.027541 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b6b45a52-e63f-40db-bd7b-87afafac22b7 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1190103166" status: 202 len: 0 microversion: 2.1 time: 0.037253 Aug 05 20:19:17.028113 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 664/1308] 10.222.0.39 () {58 vars in 1221 bytes} [Fri Aug 5 20:19:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1190103166 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:19:19.979597 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-37fde3dd-d7f0-42cb-81bf-9450a3c18741 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:19:19.980149 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-37fde3dd-d7f0-42cb-81bf-9450a3c18741 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:19:19.982517 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:19:19.988025 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-37fde3dd-d7f0-42cb-81bf-9450a3c18741 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:19.988514 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-37fde3dd-d7f0-42cb-81bf-9450a3c18741 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:19.988981 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-37fde3dd-d7f0-42cb-81bf-9450a3c18741 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:19.989694 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-37fde3dd-d7f0-42cb-81bf-9450a3c18741 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:19.990177 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-37fde3dd-d7f0-42cb-81bf-9450a3c18741 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:19.991834 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-37fde3dd-d7f0-42cb-81bf-9450a3c18741 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:19.994195 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:19:20.007857 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-37fde3dd-d7f0-42cb-81bf-9450a3c18741 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] HTTP exception thrown: Instance 81bf9fdf-5b58-462f-9d79-4405217fcdf7 could not be found. Aug 05 20:19:20.009494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-37fde3dd-d7f0-42cb-81bf-9450a3c18741 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Request method failure captured: Aug 05 20:19:20.009494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: DELETE /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7 HTTP/1.1 Aug 05 20:19:20.009494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:19:20.009494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:19:20.009494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:19:20.009494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:19:20.009494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:19:20.009494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:19:20.009494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:19:20.009494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:19:20.009494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XmXv3VSfnlBKrwyzZo0upQLfZZhWc1R88wTLpPYBPFzo6DADXU4k-ZUhjUkibgdBtjHtHw99mfvPe9gQl6pV5S3s-t-SLPCPYr6R4OC0c20T9hlbOUa_Ju24yHFLtRQagRitlbXqYyk7z2reWJraXuPNdu140ZeiR2I7Sg5-PBp5iI Aug 05 20:19:20.009494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:19:20.009494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:19:20.009494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:19:20.009494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:19:20.009494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:19:20.009494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:19:20.009494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: 790b5019b9114120a51718d99317f7a1 Aug 05 20:19:20.009494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-AttachVolumeTestJSON-1174647915 Aug 05 20:19:20.009494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:19:20.009494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:19:20.011162 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/790b5019b9114120a51718d99317f7a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/790b5019b9114120a51718d99317f7a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/790b5019b9114120a51718d99317f7a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_790b5019b9114120a51718d99317f7a1", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:19:20.011162 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-AttachVolumeTestJSON-1174647915 Aug 05 20:19:20.011162 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: 790b5019b9114120a51718d99317f7a1 Aug 05 20:19:20.011162 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1174647915 Aug 05 20:19:20.011162 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-AttachVolumeTestJSON-1174647915-project Aug 05 20:19:20.011162 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:19:20.011162 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:19:20.011162 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: 305d1ce79a4f43c8b98e0967dab43da1 Aug 05 20:19:20.011162 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-AttachVolumeTestJSON-1174647915-project Aug 05 20:19:20.011162 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: > Aug 05 20:19:20.011162 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Instance 81bf9fdf-5b58-462f-9d79-4405217fcdf7 could not be found. Aug 05 20:19:20.011162 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'id': '81bf9fdf-5b58-462f-9d79-4405217fcdf7'} Aug 05 20:19:20.012113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:19:20.012113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:19:20.012113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:19:20.012113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:19:20.012113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:19:20.012113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:19:20.012113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:19:20.012113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:19:20.012113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:19:20.012113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:19:20.012113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81bf9fdf-5b58-462f-9d79-4405217fcdf7 could not be found. Aug 05 20:19:20.012113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:19:20.012113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:19:20.012113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:19:20.012113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:19:20.012113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:19:20.012113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:19:20.012113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:19:20.012113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:19:20.012113 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:19:20.013685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:19:20.013685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:19:20.013685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:19:20.013685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:19:20.013685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:19:20.013685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:19:20.013685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:19:20.013685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:19:20.013685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:19:20.013685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81bf9fdf-5b58-462f-9d79-4405217fcdf7 could not be found. Aug 05 20:19:20.013685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:19:20.013685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:19:20.013685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:19:20.013685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:19:20.013685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:19:20.013685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:19:20.013685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:19:20.013685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:19:20.013685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81bf9fdf-5b58-462f-9d79-4405217fcdf7 could not be found. Aug 05 20:19:20.013685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:19:20.016018 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-37fde3dd-d7f0-42cb-81bf-9450a3c18741 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Returning 404 to user: Instance 81bf9fdf-5b58-462f-9d79-4405217fcdf7 could not be found. {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:19:20.016018 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-37fde3dd-d7f0-42cb-81bf-9450a3c18741 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "DELETE /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7" status: 404 len: 111 microversion: 2.1 time: 0.035242 Aug 05 20:19:20.016018 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 645/1309] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:19:19 2022] DELETE /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:19:20.021014 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a48d62e7-b4c5-4378-8c14-d9b507f5fefa tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:19:20.021631 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-a48d62e7-b4c5-4378-8c14-d9b507f5fefa tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 81bf9fdf-5b58-462f-9d79-4405217fcdf7] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:19:20.023896 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:19:20.030112 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a48d62e7-b4c5-4378-8c14-d9b507f5fefa tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:20.030606 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a48d62e7-b4c5-4378-8c14-d9b507f5fefa tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:20.031049 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a48d62e7-b4c5-4378-8c14-d9b507f5fefa tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:20.031760 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a48d62e7-b4c5-4378-8c14-d9b507f5fefa tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:20.032219 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a48d62e7-b4c5-4378-8c14-d9b507f5fefa tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:20.032670 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-a48d62e7-b4c5-4378-8c14-d9b507f5fefa tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:20.036155 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:19:20.048666 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-a48d62e7-b4c5-4378-8c14-d9b507f5fefa tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] HTTP exception thrown: Instance 81bf9fdf-5b58-462f-9d79-4405217fcdf7 could not be found. Aug 05 20:19:20.050316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a48d62e7-b4c5-4378-8c14-d9b507f5fefa tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Request method failure captured: Aug 05 20:19:20.050316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7 HTTP/1.1 Aug 05 20:19:20.050316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:19:20.050316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:19:20.050316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:19:20.050316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 0 Aug 05 20:19:20.050316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:19:20.050316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:19:20.050316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:19:20.050316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:19:20.050316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XmXv3VSfnlBKrwyzZo0upQLfZZhWc1R88wTLpPYBPFzo6DADXU4k-ZUhjUkibgdBtjHtHw99mfvPe9gQl6pV5S3s-t-SLPCPYr6R4OC0c20T9hlbOUa_Ju24yHFLtRQagRitlbXqYyk7z2reWJraXuPNdu140ZeiR2I7Sg5-PBp5iI Aug 05 20:19:20.050316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:19:20.050316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:19:20.050316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:19:20.050316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:19:20.050316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:19:20.050316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:19:20.050316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: 790b5019b9114120a51718d99317f7a1 Aug 05 20:19:20.050316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-AttachVolumeTestJSON-1174647915 Aug 05 20:19:20.050316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:19:20.050316 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:19:20.052081 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/790b5019b9114120a51718d99317f7a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/790b5019b9114120a51718d99317f7a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/790b5019b9114120a51718d99317f7a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_790b5019b9114120a51718d99317f7a1", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:19:20.052081 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-AttachVolumeTestJSON-1174647915 Aug 05 20:19:20.052081 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: 790b5019b9114120a51718d99317f7a1 Aug 05 20:19:20.052081 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1174647915 Aug 05 20:19:20.052081 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-AttachVolumeTestJSON-1174647915-project Aug 05 20:19:20.052081 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:19:20.052081 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:19:20.052081 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: 305d1ce79a4f43c8b98e0967dab43da1 Aug 05 20:19:20.052081 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-AttachVolumeTestJSON-1174647915-project Aug 05 20:19:20.052081 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: > Aug 05 20:19:20.052081 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Instance 81bf9fdf-5b58-462f-9d79-4405217fcdf7 could not be found. Aug 05 20:19:20.052081 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'id': '81bf9fdf-5b58-462f-9d79-4405217fcdf7'} Aug 05 20:19:20.053126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:19:20.053126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:19:20.053126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:19:20.053126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:19:20.053126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:19:20.053126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:19:20.053126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:19:20.053126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:19:20.053126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:19:20.053126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:19:20.053126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81bf9fdf-5b58-462f-9d79-4405217fcdf7 could not be found. Aug 05 20:19:20.053126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:19:20.053126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:19:20.053126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:19:20.053126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:19:20.053126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:19:20.053126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:19:20.053126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:19:20.053126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:19:20.053126 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:19:20.055470 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:19:20.055470 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:19:20.055470 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:19:20.055470 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:19:20.055470 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:19:20.055470 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:19:20.055470 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:19:20.055470 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81bf9fdf-5b58-462f-9d79-4405217fcdf7 could not be found. Aug 05 20:19:20.055470 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:19:20.055470 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:19:20.055470 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:19:20.055470 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:19:20.055470 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:19:20.055470 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:19:20.055470 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:19:20.055470 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:19:20.055470 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81bf9fdf-5b58-462f-9d79-4405217fcdf7 could not be found. Aug 05 20:19:20.055470 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:19:20.057886 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-a48d62e7-b4c5-4378-8c14-d9b507f5fefa tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Returning 404 to user: Instance 81bf9fdf-5b58-462f-9d79-4405217fcdf7 could not be found. {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:19:20.057886 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-a48d62e7-b4c5-4378-8c14-d9b507f5fefa tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7" status: 404 len: 111 microversion: 2.1 time: 0.035326 Aug 05 20:19:20.057886 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 665/1310] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:19:20 2022] GET /compute/v2.1/servers/81bf9fdf-5b58-462f-9d79-4405217fcdf7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:19:21.206384 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-d32e300d-b441-467c-a30e-6957b354bd90 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:19:21.207040 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-d32e300d-b441-467c-a30e-6957b354bd90 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:19:21.213563 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d32e300d-b441-467c-a30e-6957b354bd90 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:21.214056 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d32e300d-b441-467c-a30e-6957b354bd90 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:21.214494 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d32e300d-b441-467c-a30e-6957b354bd90 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:21.215234 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d32e300d-b441-467c-a30e-6957b354bd90 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:21.215688 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d32e300d-b441-467c-a30e-6957b354bd90 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:21.216120 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-d32e300d-b441-467c-a30e-6957b354bd90 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:21.230504 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.wsgi [None req-d32e300d-b441-467c-a30e-6957b354bd90 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] HTTP exception thrown: Instance 4512b727-5582-4e39-ba18-58b3c42b79f0 could not be found. Aug 05 20:19:21.232058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-d32e300d-b441-467c-a30e-6957b354bd90 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Request method failure captured: Aug 05 20:19:21.232058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: request: DELETE /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 HTTP/1.1 Aug 05 20:19:21.232058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept: application/json Aug 05 20:19:21.232058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Accept-Encoding: identity Aug 05 20:19:21.232058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Connection: close Aug 05 20:19:21.232058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Length: 0 Aug 05 20:19:21.232058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Content-Type: application/json Aug 05 20:19:21.232058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Host: 10.222.0.39 Aug 05 20:19:21.232058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Openstack-System-Scope: None Aug 05 20:19:21.232058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: User-Agent: python-urllib3/1.26.11 Aug 05 20:19:21.232058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Auth-Token: gAAAAABi7XmXv3VSfnlBKrwyzZo0upQLfZZhWc1R88wTLpPYBPFzo6DADXU4k-ZUhjUkibgdBtjHtHw99mfvPe9gQl6pV5S3s-t-SLPCPYr6R4OC0c20T9hlbOUa_Ju24yHFLtRQagRitlbXqYyk7z2reWJraXuPNdu140ZeiR2I7Sg5-PBp5iI Aug 05 20:19:21.232058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Id: None Aug 05 20:19:21.232058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Domain-Name: None Aug 05 20:19:21.232058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Identity-Status: Confirmed Aug 05 20:19:21.232058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Is-Admin-Project: True Aug 05 20:19:21.232058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Id: default Aug 05 20:19:21.232058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Domain-Name: Default Aug 05 20:19:21.232058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Id: 790b5019b9114120a51718d99317f7a1 Aug 05 20:19:21.232058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Project-Name: tempest-AttachVolumeTestJSON-1174647915 Aug 05 20:19:21.232058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Role: member,reader Aug 05 20:19:21.232058 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Roles: member,reader Aug 05 20:19:21.233978 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/790b5019b9114120a51718d99317f7a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/790b5019b9114120a51718d99317f7a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/790b5019b9114120a51718d99317f7a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_790b5019b9114120a51718d99317f7a1", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:19:21.233978 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant: tempest-AttachVolumeTestJSON-1174647915 Aug 05 20:19:21.233978 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Id: 790b5019b9114120a51718d99317f7a1 Aug 05 20:19:21.233978 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1174647915 Aug 05 20:19:21.233978 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User: tempest-AttachVolumeTestJSON-1174647915-project Aug 05 20:19:21.233978 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Id: default Aug 05 20:19:21.233978 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Domain-Name: Default Aug 05 20:19:21.233978 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Id: 305d1ce79a4f43c8b98e0967dab43da1 Aug 05 20:19:21.233978 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: X-User-Name: tempest-AttachVolumeTestJSON-1174647915-project Aug 05 20:19:21.233978 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: method: > Aug 05 20:19:21.233978 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: exception: Instance 4512b727-5582-4e39-ba18-58b3c42b79f0 could not be found. Aug 05 20:19:21.233978 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: action_args: {'id': '4512b727-5582-4e39-ba18-58b3c42b79f0'} Aug 05 20:19:21.235037 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:19:21.235037 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:19:21.235037 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:19:21.235037 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:19:21.235037 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:19:21.235037 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:19:21.235037 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:19:21.235037 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:19:21.235037 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:19:21.235037 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:19:21.235037 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4512b727-5582-4e39-ba18-58b3c42b79f0 could not be found. Aug 05 20:19:21.235037 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:19:21.235037 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:19:21.235037 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:19:21.235037 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:19:21.235037 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:19:21.235037 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:19:21.235037 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:19:21.235037 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:19:21.235037 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:19:21.236859 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:19:21.236859 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:19:21.236859 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:19:21.236859 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:19:21.236859 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:19:21.236859 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:19:21.236859 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:19:21.236859 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:19:21.236859 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:19:21.236859 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4512b727-5582-4e39-ba18-58b3c42b79f0 could not be found. Aug 05 20:19:21.236859 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:19:21.236859 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:19:21.236859 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:19:21.236859 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:19:21.236859 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:19:21.236859 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:19:21.236859 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:19:21.236859 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:19:21.236859 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4512b727-5582-4e39-ba18-58b3c42b79f0 could not be found. Aug 05 20:19:21.236859 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: ERROR nova.api.openstack.wsgi Aug 05 20:19:21.238849 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-d32e300d-b441-467c-a30e-6957b354bd90 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Returning 404 to user: Instance 4512b727-5582-4e39-ba18-58b3c42b79f0 could not be found. {{(pid=118191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:19:21.238849 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-d32e300d-b441-467c-a30e-6957b354bd90 tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 404 len: 111 microversion: 2.1 time: 0.032678 Aug 05 20:19:21.238849 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 646/1311] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:19:21 2022] DELETE /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 20:19:21.243532 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-6004b09c-7eeb-400b-b50c-b7f95845a59c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:19:21.244152 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-6004b09c-7eeb-400b-b50c-b7f95845a59c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] [instance: 4512b727-5582-4e39-ba18-58b3c42b79f0] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:19:21.251408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6004b09c-7eeb-400b-b50c-b7f95845a59c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:21.251906 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6004b09c-7eeb-400b-b50c-b7f95845a59c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:21.252345 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6004b09c-7eeb-400b-b50c-b7f95845a59c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:21.253079 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6004b09c-7eeb-400b-b50c-b7f95845a59c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:19:21.253532 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6004b09c-7eeb-400b-b50c-b7f95845a59c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:19:21.253959 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-6004b09c-7eeb-400b-b50c-b7f95845a59c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:19:21.268494 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-6004b09c-7eeb-400b-b50c-b7f95845a59c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] HTTP exception thrown: Instance 4512b727-5582-4e39-ba18-58b3c42b79f0 could not be found. Aug 05 20:19:21.270156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-6004b09c-7eeb-400b-b50c-b7f95845a59c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Request method failure captured: Aug 05 20:19:21.270156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 HTTP/1.1 Aug 05 20:19:21.270156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:19:21.270156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:19:21.270156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:19:21.270156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 0 Aug 05 20:19:21.270156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:19:21.270156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:19:21.270156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:19:21.270156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:19:21.270156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XmXv3VSfnlBKrwyzZo0upQLfZZhWc1R88wTLpPYBPFzo6DADXU4k-ZUhjUkibgdBtjHtHw99mfvPe9gQl6pV5S3s-t-SLPCPYr6R4OC0c20T9hlbOUa_Ju24yHFLtRQagRitlbXqYyk7z2reWJraXuPNdu140ZeiR2I7Sg5-PBp5iI Aug 05 20:19:21.270156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:19:21.270156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:19:21.270156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:19:21.270156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:19:21.270156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:19:21.270156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:19:21.270156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: 790b5019b9114120a51718d99317f7a1 Aug 05 20:19:21.270156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-AttachVolumeTestJSON-1174647915 Aug 05 20:19:21.270156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:19:21.270156 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:19:21.273509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/790b5019b9114120a51718d99317f7a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/790b5019b9114120a51718d99317f7a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/790b5019b9114120a51718d99317f7a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_790b5019b9114120a51718d99317f7a1", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:19:21.273509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-AttachVolumeTestJSON-1174647915 Aug 05 20:19:21.273509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: 790b5019b9114120a51718d99317f7a1 Aug 05 20:19:21.273509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1174647915 Aug 05 20:19:21.273509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-AttachVolumeTestJSON-1174647915-project Aug 05 20:19:21.273509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:19:21.273509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:19:21.273509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: 305d1ce79a4f43c8b98e0967dab43da1 Aug 05 20:19:21.273509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-AttachVolumeTestJSON-1174647915-project Aug 05 20:19:21.273509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: > Aug 05 20:19:21.273509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Instance 4512b727-5582-4e39-ba18-58b3c42b79f0 could not be found. Aug 05 20:19:21.273509 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'id': '4512b727-5582-4e39-ba18-58b3c42b79f0'} Aug 05 20:19:21.275301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:19:21.275301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:19:21.275301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:19:21.275301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:19:21.275301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:19:21.275301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:19:21.275301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:19:21.275301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:19:21.275301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:19:21.275301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:19:21.275301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4512b727-5582-4e39-ba18-58b3c42b79f0 could not be found. Aug 05 20:19:21.275301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:19:21.275301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:19:21.275301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:19:21.275301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:19:21.275301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:19:21.275301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:19:21.275301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:19:21.275301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:19:21.275301 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:19:21.278190 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:19:21.278190 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:19:21.278190 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:19:21.278190 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:19:21.278190 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:19:21.278190 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:19:21.278190 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:19:21.278190 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4512b727-5582-4e39-ba18-58b3c42b79f0 could not be found. Aug 05 20:19:21.278190 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:19:21.278190 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:19:21.278190 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:19:21.278190 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:19:21.278190 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:19:21.278190 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:19:21.278190 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:19:21.278190 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:19:21.278190 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4512b727-5582-4e39-ba18-58b3c42b79f0 could not be found. Aug 05 20:19:21.278190 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:19:21.282111 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-6004b09c-7eeb-400b-b50c-b7f95845a59c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] Returning 404 to user: Instance 4512b727-5582-4e39-ba18-58b3c42b79f0 could not be found. {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:19:21.282111 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-6004b09c-7eeb-400b-b50c-b7f95845a59c tempest-AttachVolumeTestJSON-1174647915 tempest-AttachVolumeTestJSON-1174647915-project] 10.222.0.39 "GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0" status: 404 len: 111 microversion: 2.1 time: 0.032379 Aug 05 20:19:21.282111 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 666/1312] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:19:21 2022] GET /compute/v2.1/servers/4512b727-5582-4e39-ba18-58b3c42b79f0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:19:32.083269 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:19:32.083855 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Fri Aug 5 20:19:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:19:33.181934 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:19:33.182599 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Fri Aug 5 20:19:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:20:29.801071 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_api:SELECT=3 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:20:29.801819 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell1:SELECT=3 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:20:29.805819 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a630fce8-6601-4ac2-95e0-866e01eb7748 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-252566440", "imageRef": "c148255e-9574-4d10-b9bb-13c9411eda77", "flavorRef": "452"}} {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:20:29.858682 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.network.neutron [None req-a630fce8-6601-4ac2-95e0-866e01eb7748 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] validate_networks() for None {{(pid=118191) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:20:30.132142 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-a630fce8-6601-4ac2-95e0-866e01eb7748 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Flavor limits 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:20:30.132570 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-a630fce8-6601-4ac2-95e0-866e01eb7748 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Image limits 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:20:30.133085 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-a630fce8-6601-4ac2-95e0-866e01eb7748 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Flavor pref 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:20:30.133520 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-a630fce8-6601-4ac2-95e0-866e01eb7748 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Image pref 0:0:0 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:20:30.133940 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.virt.hardware [None req-a630fce8-6601-4ac2-95e0-866e01eb7748 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:20:30.143973 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a630fce8-6601-4ac2-95e0-866e01eb7748 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:30.144463 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a630fce8-6601-4ac2-95e0-866e01eb7748 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:30.144936 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a630fce8-6601-4ac2-95e0-866e01eb7748 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:30.145680 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a630fce8-6601-4ac2-95e0-866e01eb7748 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:30.146356 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a630fce8-6601-4ac2-95e0-866e01eb7748 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:30.146560 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a630fce8-6601-4ac2-95e0-866e01eb7748 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:30.163631 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-a630fce8-6601-4ac2-95e0-866e01eb7748 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Getting quotas for project e6c662e324bb4327af67b163bb03779e. Resources: {'cores', 'ram', 'instances'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:20:30.167533 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.quota [None req-a630fce8-6601-4ac2-95e0-866e01eb7748 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Getting quotas for user 7bf88e68a7fa4c898e707126aecc8837 and project e6c662e324bb4327af67b163bb03779e. Resources: {'cores', 'ram', 'instances'} {{(pid=118191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:20:30.178788 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-a630fce8-6601-4ac2-95e0-866e01eb7748 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Going to run 1 instances... {{(pid=118191) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:20:30.181074 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-a630fce8-6601-4ac2-95e0-866e01eb7748 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] [instance: d4b7ed47-b159-48d6-9478-db511e174928] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c148255e-9574-4d10-b9bb-13c9411eda77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118191) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:20:30.227124 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-a630fce8-6601-4ac2-95e0-866e01eb7748 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.427701 Aug 05 20:20:30.227768 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 647/1313] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Aug 5 20:20:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 20:20:30.237260 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_api:SELECT=3 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:20:30.238127 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell1:SELECT=3 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:20:30.242408 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-4d4e290f-e06b-4b78-80e7-5c20c447fc7d tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:20:30.243021 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-4d4e290f-e06b-4b78-80e7-5c20c447fc7d tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] [instance: d4b7ed47-b159-48d6-9478-db511e174928] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:20:30.307867 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-4d4e290f-e06b-4b78-80e7-5c20c447fc7d tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf88e68a7fa4c898e707126aecc8837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c662e324bb4327af67b163bb03779e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:20:30.314803 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-4d4e290f-e06b-4b78-80e7-5c20c447fc7d tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] 10.222.0.39 "GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928" status: 200 len: 1214 microversion: 2.1 time: 0.079270 Aug 05 20:20:30.315638 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 667/1314] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:20:30 2022] GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:20:31.335837 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-9c859e2d-b45d-4a12-ad3c-d30e71e094cf tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:20:31.336407 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-9c859e2d-b45d-4a12-ad3c-d30e71e094cf tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] [instance: d4b7ed47-b159-48d6-9478-db511e174928] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:20:31.390347 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-9c859e2d-b45d-4a12-ad3c-d30e71e094cf tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf88e68a7fa4c898e707126aecc8837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c662e324bb4327af67b163bb03779e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:20:31.397094 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-9c859e2d-b45d-4a12-ad3c-d30e71e094cf tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] 10.222.0.39 "GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928" status: 200 len: 1214 microversion: 2.1 time: 0.065233 Aug 05 20:20:31.397918 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 648/1315] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:20:31 2022] GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:20:32.418311 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-f7675720-1a93-4704-9e23-2ce3210f3ef6 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:20:32.418847 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-f7675720-1a93-4704-9e23-2ce3210f3ef6 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] [instance: d4b7ed47-b159-48d6-9478-db511e174928] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:20:32.474037 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-f7675720-1a93-4704-9e23-2ce3210f3ef6 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf88e68a7fa4c898e707126aecc8837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c662e324bb4327af67b163bb03779e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:20:32.480779 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-f7675720-1a93-4704-9e23-2ce3210f3ef6 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] 10.222.0.39 "GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928" status: 200 len: 1214 microversion: 2.1 time: 0.066520 Aug 05 20:20:32.481341 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 668/1316] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:20:32 2022] GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:20:33.501814 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-48b5bc81-44d5-488a-b7c0-2898edefdfb8 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:20:33.502385 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-48b5bc81-44d5-488a-b7c0-2898edefdfb8 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] [instance: d4b7ed47-b159-48d6-9478-db511e174928] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:20:33.509809 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-48b5bc81-44d5-488a-b7c0-2898edefdfb8 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:33.510300 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-48b5bc81-44d5-488a-b7c0-2898edefdfb8 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:33.510738 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-48b5bc81-44d5-488a-b7c0-2898edefdfb8 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:33.511426 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-48b5bc81-44d5-488a-b7c0-2898edefdfb8 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:33.511897 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-48b5bc81-44d5-488a-b7c0-2898edefdfb8 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:33.512315 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-48b5bc81-44d5-488a-b7c0-2898edefdfb8 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:33.574267 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-48b5bc81-44d5-488a-b7c0-2898edefdfb8 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf88e68a7fa4c898e707126aecc8837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c662e324bb4327af67b163bb03779e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:20:33.582274 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-48b5bc81-44d5-488a-b7c0-2898edefdfb8 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] 10.222.0.39 "GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928" status: 200 len: 1218 microversion: 2.1 time: 0.085023 Aug 05 20:20:33.582845 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 649/1317] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:20:33 2022] GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:20:34.606796 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-0f1a086a-ead8-49ee-afbe-e9fcbf3a0d68 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:20:34.607537 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-0f1a086a-ead8-49ee-afbe-e9fcbf3a0d68 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] [instance: d4b7ed47-b159-48d6-9478-db511e174928] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:20:34.614092 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0f1a086a-ead8-49ee-afbe-e9fcbf3a0d68 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:34.614586 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0f1a086a-ead8-49ee-afbe-e9fcbf3a0d68 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:34.615187 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0f1a086a-ead8-49ee-afbe-e9fcbf3a0d68 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:34.616050 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0f1a086a-ead8-49ee-afbe-e9fcbf3a0d68 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:34.616708 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0f1a086a-ead8-49ee-afbe-e9fcbf3a0d68 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:34.618060 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-0f1a086a-ead8-49ee-afbe-e9fcbf3a0d68 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:34.705181 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-0f1a086a-ead8-49ee-afbe-e9fcbf3a0d68 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf88e68a7fa4c898e707126aecc8837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c662e324bb4327af67b163bb03779e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:20:34.713762 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-0f1a086a-ead8-49ee-afbe-e9fcbf3a0d68 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] 10.222.0.39 "GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928" status: 200 len: 1272 microversion: 2.1 time: 0.113479 Aug 05 20:20:34.714339 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 669/1318] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:20:34 2022] GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928 => generated 1272 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:20:35.738784 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-f407f73e-e5a8-419c-9a87-71c56b840f56 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:20:35.739796 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-f407f73e-e5a8-419c-9a87-71c56b840f56 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] [instance: d4b7ed47-b159-48d6-9478-db511e174928] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:20:35.751215 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f407f73e-e5a8-419c-9a87-71c56b840f56 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:35.751995 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f407f73e-e5a8-419c-9a87-71c56b840f56 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:35.752731 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f407f73e-e5a8-419c-9a87-71c56b840f56 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:35.753869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f407f73e-e5a8-419c-9a87-71c56b840f56 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:35.754604 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f407f73e-e5a8-419c-9a87-71c56b840f56 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:35.755290 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-f407f73e-e5a8-419c-9a87-71c56b840f56 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:36.032435 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-f407f73e-e5a8-419c-9a87-71c56b840f56 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf88e68a7fa4c898e707126aecc8837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c662e324bb4327af67b163bb03779e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:20:36.040162 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-f407f73e-e5a8-419c-9a87-71c56b840f56 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] 10.222.0.39 "GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928" status: 200 len: 1314 microversion: 2.1 time: 0.308654 Aug 05 20:20:36.040778 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 650/1319] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:20:35 2022] GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:20:36.352062 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-718fde40-0339-4ff3-95e1-5fae6b55c1bb req-1459aa11-5535-48d7-8992-99a304734826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b7ed47-b159-48d6-9478-db511e174928", "tag": "4fa0dcaa-45fd-4d07-a373-32c2a58bc0b7"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:20:36.363671 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-718fde40-0339-4ff3-95e1-5fae6b55c1bb req-1459aa11-5535-48d7-8992-99a304734826 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:36.364154 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-718fde40-0339-4ff3-95e1-5fae6b55c1bb req-1459aa11-5535-48d7-8992-99a304734826 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:36.364617 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-718fde40-0339-4ff3-95e1-5fae6b55c1bb req-1459aa11-5535-48d7-8992-99a304734826 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:36.377430 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-718fde40-0339-4ff3-95e1-5fae6b55c1bb req-1459aa11-5535-48d7-8992-99a304734826 service nova] Creating event network-changed:4fa0dcaa-45fd-4d07-a373-32c2a58bc0b7 for instance d4b7ed47-b159-48d6-9478-db511e174928 on hv-cinder-85221 Aug 05 20:20:36.383287 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-718fde40-0339-4ff3-95e1-5fae6b55c1bb req-1459aa11-5535-48d7-8992-99a304734826 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035857 Aug 05 20:20:36.384159 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 670/1320] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:20:37.062984 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-0e069443-d121-4462-aa6d-82bc88a40bbd tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:20:37.063587 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-0e069443-d121-4462-aa6d-82bc88a40bbd tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] [instance: d4b7ed47-b159-48d6-9478-db511e174928] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:20:37.070268 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0e069443-d121-4462-aa6d-82bc88a40bbd tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:37.070753 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0e069443-d121-4462-aa6d-82bc88a40bbd tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:37.071187 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0e069443-d121-4462-aa6d-82bc88a40bbd tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:37.071878 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0e069443-d121-4462-aa6d-82bc88a40bbd tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:37.072334 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0e069443-d121-4462-aa6d-82bc88a40bbd tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:37.072791 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-0e069443-d121-4462-aa6d-82bc88a40bbd tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:37.209347 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-0e069443-d121-4462-aa6d-82bc88a40bbd tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf88e68a7fa4c898e707126aecc8837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c662e324bb4327af67b163bb03779e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:20:37.216879 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-0e069443-d121-4462-aa6d-82bc88a40bbd tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] 10.222.0.39 "GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928" status: 200 len: 1314 microversion: 2.1 time: 0.158587 Aug 05 20:20:37.217457 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 651/1321] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:20:37 2022] GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:20:38.238432 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-b5108475-0195-43dd-a245-17116f6bd07b tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:20:38.239057 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-b5108475-0195-43dd-a245-17116f6bd07b tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] [instance: d4b7ed47-b159-48d6-9478-db511e174928] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:20:38.245158 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5108475-0195-43dd-a245-17116f6bd07b tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:38.245639 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5108475-0195-43dd-a245-17116f6bd07b tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:38.246078 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5108475-0195-43dd-a245-17116f6bd07b tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:38.246762 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5108475-0195-43dd-a245-17116f6bd07b tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:38.247213 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5108475-0195-43dd-a245-17116f6bd07b tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:38.247633 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-b5108475-0195-43dd-a245-17116f6bd07b tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:38.390728 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-b5108475-0195-43dd-a245-17116f6bd07b tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf88e68a7fa4c898e707126aecc8837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c662e324bb4327af67b163bb03779e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:20:38.398369 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-b5108475-0195-43dd-a245-17116f6bd07b tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] 10.222.0.39 "GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928" status: 200 len: 1314 microversion: 2.1 time: 0.164675 Aug 05 20:20:38.398937 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 671/1322] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:20:38 2022] GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:20:39.420346 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-1e423a41-d0dd-448c-a36d-a3db0e4774cc tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:20:39.421035 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-1e423a41-d0dd-448c-a36d-a3db0e4774cc tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] [instance: d4b7ed47-b159-48d6-9478-db511e174928] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:20:39.427535 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1e423a41-d0dd-448c-a36d-a3db0e4774cc tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:39.428018 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1e423a41-d0dd-448c-a36d-a3db0e4774cc tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:39.428453 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1e423a41-d0dd-448c-a36d-a3db0e4774cc tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:39.429175 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1e423a41-d0dd-448c-a36d-a3db0e4774cc tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:39.429625 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1e423a41-d0dd-448c-a36d-a3db0e4774cc tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:39.430049 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-1e423a41-d0dd-448c-a36d-a3db0e4774cc tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:39.563705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-1e423a41-d0dd-448c-a36d-a3db0e4774cc tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf88e68a7fa4c898e707126aecc8837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c662e324bb4327af67b163bb03779e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:20:39.571114 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-1e423a41-d0dd-448c-a36d-a3db0e4774cc tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] 10.222.0.39 "GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928" status: 200 len: 1314 microversion: 2.1 time: 0.155122 Aug 05 20:20:39.571678 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 652/1323] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:20:39 2022] GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:20:40.591482 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-d390c51f-4d97-4795-b7ae-f249dd987fdf tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:20:40.592717 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-d390c51f-4d97-4795-b7ae-f249dd987fdf tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] [instance: d4b7ed47-b159-48d6-9478-db511e174928] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:20:40.599048 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d390c51f-4d97-4795-b7ae-f249dd987fdf tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:40.599526 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d390c51f-4d97-4795-b7ae-f249dd987fdf tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:40.599954 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d390c51f-4d97-4795-b7ae-f249dd987fdf tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:40.600658 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d390c51f-4d97-4795-b7ae-f249dd987fdf tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:40.601113 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d390c51f-4d97-4795-b7ae-f249dd987fdf tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:40.601535 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-d390c51f-4d97-4795-b7ae-f249dd987fdf tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:40.740638 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-d390c51f-4d97-4795-b7ae-f249dd987fdf tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf88e68a7fa4c898e707126aecc8837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c662e324bb4327af67b163bb03779e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:20:40.748890 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-d390c51f-4d97-4795-b7ae-f249dd987fdf tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] 10.222.0.39 "GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928" status: 200 len: 1314 microversion: 2.1 time: 0.161140 Aug 05 20:20:40.749452 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 672/1324] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:20:40 2022] GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:20:41.769807 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-c41a16e1-f6bd-4c66-9601-7cc543a9f008 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:20:41.770419 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-c41a16e1-f6bd-4c66-9601-7cc543a9f008 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] [instance: d4b7ed47-b159-48d6-9478-db511e174928] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:20:41.773220 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=2 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:20:41.773770 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG dbcounter [-] [118191] Writing DB stats nova_cell0:SELECT=8 {{(pid=118191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:20:41.780601 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c41a16e1-f6bd-4c66-9601-7cc543a9f008 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:41.781076 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c41a16e1-f6bd-4c66-9601-7cc543a9f008 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:41.781757 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c41a16e1-f6bd-4c66-9601-7cc543a9f008 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:41.782450 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c41a16e1-f6bd-4c66-9601-7cc543a9f008 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:41.782825 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c41a16e1-f6bd-4c66-9601-7cc543a9f008 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:41.782825 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-c41a16e1-f6bd-4c66-9601-7cc543a9f008 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:41.923330 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-c41a16e1-f6bd-4c66-9601-7cc543a9f008 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf88e68a7fa4c898e707126aecc8837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c662e324bb4327af67b163bb03779e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:20:41.931001 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-c41a16e1-f6bd-4c66-9601-7cc543a9f008 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] 10.222.0.39 "GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928" status: 200 len: 1314 microversion: 2.1 time: 0.165051 Aug 05 20:20:41.931685 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 653/1325] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:20:41 2022] GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:20:42.070183 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-62d8c5b9-ac56-4ae7-ab2e-0f51a96b7994 req-7759b63b-ee6a-43d6-a764-64e072a371f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b7ed47-b159-48d6-9478-db511e174928", "name": "network-vif-plugged", "status": "completed", "tag": "4fa0dcaa-45fd-4d07-a373-32c2a58bc0b7"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:20:42.080352 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-62d8c5b9-ac56-4ae7-ab2e-0f51a96b7994 req-7759b63b-ee6a-43d6-a764-64e072a371f1 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:42.080868 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-62d8c5b9-ac56-4ae7-ab2e-0f51a96b7994 req-7759b63b-ee6a-43d6-a764-64e072a371f1 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:42.081297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-62d8c5b9-ac56-4ae7-ab2e-0f51a96b7994 req-7759b63b-ee6a-43d6-a764-64e072a371f1 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:42.092321 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-62d8c5b9-ac56-4ae7-ab2e-0f51a96b7994 req-7759b63b-ee6a-43d6-a764-64e072a371f1 service nova] Creating event network-vif-plugged:4fa0dcaa-45fd-4d07-a373-32c2a58bc0b7 for instance d4b7ed47-b159-48d6-9478-db511e174928 on hv-cinder-85221 Aug 05 20:20:42.097211 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-62d8c5b9-ac56-4ae7-ab2e-0f51a96b7994 req-7759b63b-ee6a-43d6-a764-64e072a371f1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155184 Aug 05 20:20:42.097791 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 673/1326] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:20:42.952942 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-a6f424db-20ce-4b8e-bb88-2a7167ea5ed6 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:20:42.953560 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-a6f424db-20ce-4b8e-bb88-2a7167ea5ed6 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] [instance: d4b7ed47-b159-48d6-9478-db511e174928] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:20:42.959890 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a6f424db-20ce-4b8e-bb88-2a7167ea5ed6 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:42.960403 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a6f424db-20ce-4b8e-bb88-2a7167ea5ed6 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:42.960869 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a6f424db-20ce-4b8e-bb88-2a7167ea5ed6 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:42.961560 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a6f424db-20ce-4b8e-bb88-2a7167ea5ed6 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:42.962019 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a6f424db-20ce-4b8e-bb88-2a7167ea5ed6 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:42.962451 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-a6f424db-20ce-4b8e-bb88-2a7167ea5ed6 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:43.097158 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-a6f424db-20ce-4b8e-bb88-2a7167ea5ed6 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf88e68a7fa4c898e707126aecc8837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c662e324bb4327af67b163bb03779e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:20:43.104626 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-a6f424db-20ce-4b8e-bb88-2a7167ea5ed6 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] 10.222.0.39 "GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928" status: 200 len: 1314 microversion: 2.1 time: 0.155961 Aug 05 20:20:43.105193 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 654/1327] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:20:42 2022] GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:20:44.122913 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG dbcounter [-] [118192] Writing DB stats nova_cell0:SELECT=4 {{(pid=118192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:20:44.127973 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-edcdbe9c-a464-45e5-9596-57755698fba3 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:20:44.128705 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-edcdbe9c-a464-45e5-9596-57755698fba3 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] [instance: d4b7ed47-b159-48d6-9478-db511e174928] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:20:44.135053 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-edcdbe9c-a464-45e5-9596-57755698fba3 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:44.135561 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-edcdbe9c-a464-45e5-9596-57755698fba3 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:44.136027 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-edcdbe9c-a464-45e5-9596-57755698fba3 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:44.136841 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-edcdbe9c-a464-45e5-9596-57755698fba3 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:44.137293 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-edcdbe9c-a464-45e5-9596-57755698fba3 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:44.137714 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-edcdbe9c-a464-45e5-9596-57755698fba3 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:44.274642 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-edcdbe9c-a464-45e5-9596-57755698fba3 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf88e68a7fa4c898e707126aecc8837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c662e324bb4327af67b163bb03779e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:20:44.283107 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-edcdbe9c-a464-45e5-9596-57755698fba3 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] 10.222.0.39 "GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928" status: 200 len: 1464 microversion: 2.1 time: 0.161083 Aug 05 20:20:44.283667 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 674/1328] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:20:44 2022] GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928 => generated 1464 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:20:44.328749 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-97d19e12-c5f0-4b7b-82bc-abbbebdf9ce8 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:20:44.329313 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-97d19e12-c5f0-4b7b-82bc-abbbebdf9ce8 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] [instance: d4b7ed47-b159-48d6-9478-db511e174928] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:20:44.335219 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-97d19e12-c5f0-4b7b-82bc-abbbebdf9ce8 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:44.335705 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-97d19e12-c5f0-4b7b-82bc-abbbebdf9ce8 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:44.336143 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-97d19e12-c5f0-4b7b-82bc-abbbebdf9ce8 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:44.336868 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-97d19e12-c5f0-4b7b-82bc-abbbebdf9ce8 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:44.337324 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-97d19e12-c5f0-4b7b-82bc-abbbebdf9ce8 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:44.337750 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-97d19e12-c5f0-4b7b-82bc-abbbebdf9ce8 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:44.363829 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-97d19e12-c5f0-4b7b-82bc-abbbebdf9ce8 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] [instance: d4b7ed47-b159-48d6-9478-db511e174928] Going to try to terminate instance {{(pid=118191) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:20:44.439372 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-97d19e12-c5f0-4b7b-82bc-abbbebdf9ce8 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928" status: 204 len: 0 microversion: 2.1 time: 0.114972 Aug 05 20:20:44.439968 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 655/1329] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Aug 5 20:20:44 2022] DELETE /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:20:44.448244 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-e109a02e-5130-4e9a-a1d8-79ed3e52a6cb tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:20:44.448884 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-e109a02e-5130-4e9a-a1d8-79ed3e52a6cb tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] [instance: d4b7ed47-b159-48d6-9478-db511e174928] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:20:44.455440 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e109a02e-5130-4e9a-a1d8-79ed3e52a6cb tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:44.455925 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e109a02e-5130-4e9a-a1d8-79ed3e52a6cb tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:44.456362 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e109a02e-5130-4e9a-a1d8-79ed3e52a6cb tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:44.457079 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e109a02e-5130-4e9a-a1d8-79ed3e52a6cb tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:44.457534 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e109a02e-5130-4e9a-a1d8-79ed3e52a6cb tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:44.457965 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-e109a02e-5130-4e9a-a1d8-79ed3e52a6cb tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:44.589721 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.policy [None req-e109a02e-5130-4e9a-a1d8-79ed3e52a6cb tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf88e68a7fa4c898e707126aecc8837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c662e324bb4327af67b163bb03779e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:20:44.597514 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-e109a02e-5130-4e9a-a1d8-79ed3e52a6cb tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] 10.222.0.39 "GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928" status: 200 len: 1470 microversion: 2.1 time: 0.153100 Aug 05 20:20:44.598081 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 675/1330] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:20:44 2022] GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:20:45.619435 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-73d2e5a6-ee95-4e3f-badf-9cbdd795e3fb tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:20:45.620044 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-73d2e5a6-ee95-4e3f-badf-9cbdd795e3fb tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] [instance: d4b7ed47-b159-48d6-9478-db511e174928] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:20:45.627955 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-73d2e5a6-ee95-4e3f-badf-9cbdd795e3fb tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:45.628470 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-73d2e5a6-ee95-4e3f-badf-9cbdd795e3fb tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:45.628933 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-73d2e5a6-ee95-4e3f-badf-9cbdd795e3fb tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:45.629628 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-73d2e5a6-ee95-4e3f-badf-9cbdd795e3fb tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:45.630079 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-73d2e5a6-ee95-4e3f-badf-9cbdd795e3fb tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:45.630501 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-73d2e5a6-ee95-4e3f-badf-9cbdd795e3fb tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:45.761367 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-73d2e5a6-ee95-4e3f-badf-9cbdd795e3fb tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf88e68a7fa4c898e707126aecc8837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c662e324bb4327af67b163bb03779e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:20:45.768940 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-73d2e5a6-ee95-4e3f-badf-9cbdd795e3fb tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] 10.222.0.39 "GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928" status: 200 len: 1470 microversion: 2.1 time: 0.153968 Aug 05 20:20:45.769512 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 656/1331] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:20:45 2022] GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:20:46.524748 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [req-4b1e504a-0cc5-4745-a701-98ee2fb0efe4 req-e40b4d82-cefb-4e2b-b731-435b13d38577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b7ed47-b159-48d6-9478-db511e174928", "name": "network-vif-deleted", "tag": "4fa0dcaa-45fd-4d07-a373-32c2a58bc0b7"}]} {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:20:46.539370 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-4b1e504a-0cc5-4745-a701-98ee2fb0efe4 req-e40b4d82-cefb-4e2b-b731-435b13d38577 service nova] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:46.539647 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-4b1e504a-0cc5-4745-a701-98ee2fb0efe4 req-e40b4d82-cefb-4e2b-b731-435b13d38577 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:46.540664 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [req-4b1e504a-0cc5-4745-a701-98ee2fb0efe4 req-e40b4d82-cefb-4e2b-b731-435b13d38577 service nova] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:46.553984 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.compute.server_external_events [req-4b1e504a-0cc5-4745-a701-98ee2fb0efe4 req-e40b4d82-cefb-4e2b-b731-435b13d38577 service nova] Creating event network-vif-deleted:4fa0dcaa-45fd-4d07-a373-32c2a58bc0b7 for instance d4b7ed47-b159-48d6-9478-db511e174928 on hv-cinder-85221 Aug 05 20:20:46.559095 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [req-4b1e504a-0cc5-4745-a701-98ee2fb0efe4 req-e40b4d82-cefb-4e2b-b731-435b13d38577 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044096 Aug 05 20:20:46.559690 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 676/1332] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Aug 5 20:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:20:46.790590 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.api.openstack.wsgi [None req-3011807e-dc5e-4b64-8046-4df93e094031 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Calling method '>' {{(pid=118191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:20:46.791130 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.compute.api [None req-3011807e-dc5e-4b64-8046-4df93e094031 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] [instance: d4b7ed47-b159-48d6-9478-db511e174928] Fetching instance by UUID {{(pid=118191) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:20:46.799409 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3011807e-dc5e-4b64-8046-4df93e094031 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:46.799707 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3011807e-dc5e-4b64-8046-4df93e094031 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:46.800020 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3011807e-dc5e-4b64-8046-4df93e094031 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:46.800797 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3011807e-dc5e-4b64-8046-4df93e094031 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:46.801253 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3011807e-dc5e-4b64-8046-4df93e094031 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:46.801682 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3011807e-dc5e-4b64-8046-4df93e094031 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:46.837000 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3011807e-dc5e-4b64-8046-4df93e094031 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:46.837485 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3011807e-dc5e-4b64-8046-4df93e094031 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:46.837923 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG oslo_concurrency.lockutils [None req-3011807e-dc5e-4b64-8046-4df93e094031 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:46.838370 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.objects.instance [None req-3011807e-dc5e-4b64-8046-4df93e094031 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lazy-loading 'fault' on Instance uuid d4b7ed47-b159-48d6-9478-db511e174928 {{(pid=118191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:20:46.880776 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: DEBUG nova.policy [None req-3011807e-dc5e-4b64-8046-4df93e094031 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf88e68a7fa4c898e707126aecc8837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6c662e324bb4327af67b163bb03779e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:20:46.889721 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO nova.api.openstack.requestlog [None req-3011807e-dc5e-4b64-8046-4df93e094031 tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] 10.222.0.39 "GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928" status: 200 len: 1304 microversion: 2.1 time: 0.103056 Aug 05 20:20:46.890309 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: [pid: 118191|app: 0|req: 657/1333] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:20:46 2022] GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:20:47.913186 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-137b8e18-7635-4c34-a410-95ae0958616e tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Calling method '>' {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:20:47.913925 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.compute.api [None req-137b8e18-7635-4c34-a410-95ae0958616e tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] [instance: d4b7ed47-b159-48d6-9478-db511e174928] Fetching instance by UUID {{(pid=118192) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:20:47.920871 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-137b8e18-7635-4c34-a410-95ae0958616e tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:47.921297 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-137b8e18-7635-4c34-a410-95ae0958616e tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:47.921742 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-137b8e18-7635-4c34-a410-95ae0958616e tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:47.922447 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-137b8e18-7635-4c34-a410-95ae0958616e tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Acquiring lock "0ecc5c16-c10c-4818-88aa-214f9c959337" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:20:47.922912 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-137b8e18-7635-4c34-a410-95ae0958616e tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:20:47.923344 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG oslo_concurrency.lockutils [None req-137b8e18-7635-4c34-a410-95ae0958616e tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Lock "0ecc5c16-c10c-4818-88aa-214f9c959337" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:20:47.938165 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.wsgi [None req-137b8e18-7635-4c34-a410-95ae0958616e tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] HTTP exception thrown: Instance d4b7ed47-b159-48d6-9478-db511e174928 could not be found. Aug 05 20:20:47.939850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-137b8e18-7635-4c34-a410-95ae0958616e tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Request method failure captured: Aug 05 20:20:47.939850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: request: GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928 HTTP/1.1 Aug 05 20:20:47.939850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept: application/json Aug 05 20:20:47.939850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Accept-Encoding: identity Aug 05 20:20:47.939850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Connection: close Aug 05 20:20:47.939850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Length: 0 Aug 05 20:20:47.939850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Content-Type: application/json Aug 05 20:20:47.939850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Host: 10.222.0.39 Aug 05 20:20:47.939850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Openstack-System-Scope: None Aug 05 20:20:47.939850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: User-Agent: python-urllib3/1.26.11 Aug 05 20:20:47.939850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Auth-Token: gAAAAABi7XuMmt33KUnFMcHCKOX944XK3ocQzK7yGaGkVeQ6897kRWj7j8E0qdACEnY_hgYrjQdaiPsyhWQ3d5OPIX4M0KVqCZbeOcsHEKzK4le-MUi7wq8cwtuyAt_AlLF2CBlM-7wN_NQzUVr55QsNxvdWSZA5ecKTdd_Un0VRoMBrEtqmdsA Aug 05 20:20:47.939850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Id: None Aug 05 20:20:47.939850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Domain-Name: None Aug 05 20:20:47.939850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Identity-Status: Confirmed Aug 05 20:20:47.939850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Is-Admin-Project: True Aug 05 20:20:47.939850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Id: default Aug 05 20:20:47.939850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Domain-Name: Default Aug 05 20:20:47.939850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Id: e6c662e324bb4327af67b163bb03779e Aug 05 20:20:47.939850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Project-Name: tempest-VolumesNegativeTest-1951035857 Aug 05 20:20:47.939850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Role: member,reader Aug 05 20:20:47.939850 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Roles: member,reader Aug 05 20:20:47.941844 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e6c662e324bb4327af67b163bb03779e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e6c662e324bb4327af67b163bb03779e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e6c662e324bb4327af67b163bb03779e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e6c662e324bb4327af67b163bb03779e", "adminURL": "http://10.222.0.39:8080"}]}] Aug 05 20:20:47.941844 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant: tempest-VolumesNegativeTest-1951035857 Aug 05 20:20:47.941844 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Id: e6c662e324bb4327af67b163bb03779e Aug 05 20:20:47.941844 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-Tenant-Name: tempest-VolumesNegativeTest-1951035857 Aug 05 20:20:47.941844 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User: tempest-VolumesNegativeTest-1951035857-project Aug 05 20:20:47.941844 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Id: default Aug 05 20:20:47.941844 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Domain-Name: Default Aug 05 20:20:47.941844 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Id: 7bf88e68a7fa4c898e707126aecc8837 Aug 05 20:20:47.941844 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: X-User-Name: tempest-VolumesNegativeTest-1951035857-project Aug 05 20:20:47.941844 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: method: > Aug 05 20:20:47.941844 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: exception: Instance d4b7ed47-b159-48d6-9478-db511e174928 could not be found. Aug 05 20:20:47.941844 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: action_args: {'id': 'd4b7ed47-b159-48d6-9478-db511e174928'} Aug 05 20:20:47.942755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: {{(pid=118192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:20:47.942755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:20:47.942755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:20:47.942755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:20:47.942755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:20:47.942755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:20:47.942755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:20:47.942755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:20:47.942755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:20:47.942755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:20:47.942755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4b7ed47-b159-48d6-9478-db511e174928 could not be found. Aug 05 20:20:47.942755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:20:47.942755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:20:47.942755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:20:47.942755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:20:47.942755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:20:47.942755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:20:47.942755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:20:47.942755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:20:47.942755 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:20:47.944483 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:20:47.944483 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:20:47.944483 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:20:47.944483 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:20:47.944483 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:20:47.944483 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:20:47.944483 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:20:47.944483 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4b7ed47-b159-48d6-9478-db511e174928 could not be found. Aug 05 20:20:47.944483 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:20:47.944483 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:20:47.944483 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:20:47.944483 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:20:47.944483 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:20:47.944483 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:20:47.944483 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:20:47.944483 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:20:47.944483 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4b7ed47-b159-48d6-9478-db511e174928 could not be found. Aug 05 20:20:47.944483 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: ERROR nova.api.openstack.wsgi Aug 05 20:20:47.946075 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: DEBUG nova.api.openstack.wsgi [None req-137b8e18-7635-4c34-a410-95ae0958616e tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] Returning 404 to user: Instance d4b7ed47-b159-48d6-9478-db511e174928 could not be found. {{(pid=118192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:20:47.946075 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO nova.api.openstack.requestlog [None req-137b8e18-7635-4c34-a410-95ae0958616e tempest-VolumesNegativeTest-1951035857 tempest-VolumesNegativeTest-1951035857-project] 10.222.0.39 "GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928" status: 404 len: 111 microversion: 2.1 time: 0.032799 Aug 05 20:20:47.946075 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: [pid: 118192|app: 0|req: 677/1334] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Aug 5 20:20:47 2022] GET /compute/v2.1/servers/d4b7ed47-b159-48d6-9478-db511e174928 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:22:21.896794 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:22:21.897433 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Fri Aug 5 20:22:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:22:52.093885 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:22:52.094610 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Fri Aug 5 20:22:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:22:53.192173 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:22:53.192828 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Fri Aug 5 20:22:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:23:06.502543 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:23:06.503201 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Fri Aug 5 20:23:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:23:24.716031 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:23:24.716858 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Fri Aug 5 20:23:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:24:28.800107 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:24:28.800821 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Fri Aug 5 20:24:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:25:41.906126 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:25:41.906753 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Fri Aug 5 20:25:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:26:12.104486 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:26:12.105221 dv-cinder-852210-2-iscsi devstack@n-api.service[118191]: Fri Aug 5 20:26:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:26:13.202173 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:26:13.202742 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Fri Aug 5 20:26:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:26:26.511186 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:26:26.511953 dv-cinder-852210-2-iscsi devstack@n-api.service[118192]: Fri Aug 5 20:26:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!